-- Logs begin at Tue 2022-03-22 19:08:44 UTC, end at Tue 2022-03-22 20:22:22 UTC. -- Mar 22 19:37:57.945321 dv-cinder-739079-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 22 19:37:57.955913 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 22 19:37:57 2022] *** Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: nodename: dv-cinder-739079-9-iscsi Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: machine: x86_64 Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: clock source: unix Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: pcre jit disabled Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: detected number of CPU cores: 4 Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: current working directory: / Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: detected binary path: /usr/bin/uwsgi-core Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: your processes number limit is 47680 Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: your memory page size is 4096 bytes Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: detected max file descriptor number: 2048 Mar 22 19:37:57.958032 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: lock engine: pthread robust mutexes Mar 22 19:37:57.959310 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: thunder lock: enabled Mar 22 19:37:57.959310 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 22 19:37:57.959310 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 22 19:37:58.005261 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: Python main interpreter initialized at 0x561c031939c0 Mar 22 19:37:58.005261 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: python threads support enabled Mar 22 19:37:58.005261 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: your server socket listen backlog is limited to 100 connections Mar 22 19:37:58.005261 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: your mercy for graceful operations on workers is 90 seconds Mar 22 19:37:58.005815 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: mapped 403077 bytes (393 KB) for 2 cores Mar 22 19:37:58.005815 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: *** Operational MODE: preforking *** Mar 22 19:37:58.006066 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: *** uWSGI is running in multiple interpreter mode *** Mar 22 19:37:58.006066 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: spawned uWSGI master process (pid: 91327) Mar 22 19:37:58.006278 dv-cinder-739079-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 22 19:37:58.008756 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: spawned uWSGI worker 1 (pid: 91344, cores: 1) Mar 22 19:37:58.008756 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: spawned uWSGI worker 2 (pid: 91345, cores: 1) Mar 22 19:37:58.008756 dv-cinder-739079-9-iscsi devstack@keystone.service[91327]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 22 19:38:04.428480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 22 19:38:04.428480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: from cryptography.utils import int_from_bytes Mar 22 19:38:04.429692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 22 19:38:04.429692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: from cryptography.utils import int_from_bytes Mar 22 19:38:04.475508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 22 19:38:04.475715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 22 19:38:04.475935 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] command line args: [] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 22 19:38:04.476140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 22 19:38:04.476301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ================================================================================ {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 22 19:38:04.476576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] admin_token = **** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.476826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] config_dir = [] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.477000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.477188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] config_source = [] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.477339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] debug = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.477555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] list_limit = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] log_config_append = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] log_dir = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] log_file = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.480783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.481203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.481302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.481489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.481719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.481968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.482203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.482473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.482694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.482984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.483492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.483692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] publish_errors = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.483918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.484076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.484265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.484488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.484736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.484958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] standard_threads = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.485176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.485436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.485622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.485814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] use_journal = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.486026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] use_json = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.486197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] use_stderr = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.486332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] use_syslog = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.486498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:04.486759 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.486989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.487250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.487494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.487747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.487986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.488232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.488470 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.488720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.488967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.489217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.489452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.489702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.489966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.490214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.490469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.490691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.490953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.491208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.491473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.491688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.491944 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.492209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.492462 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.492716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.492948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.493178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.493407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.493644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.493899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.494180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.494390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.494622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.494891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.495144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.495384 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.495633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.495864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.496103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.496338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.496570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.496800 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.497031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.497268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.497496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.497752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.498008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.498249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.498480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.498718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.498957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.499200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.499431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.499671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.499909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.500143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.500381 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.500616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.500829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.501088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.501325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.501565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.501798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.502088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.502309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.502545 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.502782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.503017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.503290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.503531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.503781 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.504031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.504269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.504507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.504744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.504991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.505234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.505472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.505699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.505967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.506201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.506436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.506672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.506904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.507167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.507426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.507668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.507909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.508151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.508393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.508635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.508880 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.509109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.509341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.509575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.509811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.510109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.510305 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.510573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.510853 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.511098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.511356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.511619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.511861 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.512099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] auth.external = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.512325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.512622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.512854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.513090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] auth.password = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.513397 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] auth.token = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.513546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.513762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.514031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.514266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.514525 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.514775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.515007 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.515241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] credential.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.515486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.515737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.515981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.516220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.516468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.516703 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.516961 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.517211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.517446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.517696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.518006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.518254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.518516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.518757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.519013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.519247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] federation.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.519488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.519732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.519972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.520202 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.520446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.520691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.520950 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.521182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.522860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.522860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.522860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.522860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.522860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.522860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.522860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.524336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.524336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.524336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.524336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.524336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.524336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.525501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.525501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.525501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.525501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.525501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.526712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.526712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.526712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.526712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.526712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.527827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.527827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.527827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.527827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.527827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.528608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.528608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.528608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.528608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.529231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.529231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.529523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.529523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.529899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.530073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.530248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.530533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.530729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.530929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.531176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.531414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.531654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.531899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.532161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.532389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.532625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.532866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.533112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.533347 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.533582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.533817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.534078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.534323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.534596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.534828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.535077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.535335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.535564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.535801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.536033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.536276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.536524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.536793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.537026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.537272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.537517 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.537763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.538033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.538280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.538511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.538766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.539038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.539282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.539520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.539758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.540417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.540417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.540779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.540779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.541074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.541251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.541489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.541751 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.542071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.542315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.542557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.542789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.543033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.543255 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] resource.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.543503 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.543752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.543990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.544240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.544499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.544723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.544961 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.545208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.545454 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.545686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] role.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.545930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] role.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.546196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.546451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.546709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.546960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.547211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.547460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.547707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.547962 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.548209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.548439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.548688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.548942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.549191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.549432 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.549868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.550159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.550414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.550663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.550915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.551173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.551385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.551643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.551894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.552132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.552362 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.552592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.552823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.553074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.553330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.553579 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.553819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.554080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.554295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.554529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] token.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.554766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.555013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.555256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.555581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.555732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.555964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.556207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.556452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.556695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.556932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.557170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.557467 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.557812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.558107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.558339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.558585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.558886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.559148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.connection = **** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.559393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.559641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.559884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.560134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.560364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.560604 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.560851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.561091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.561335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.561573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.561822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.562091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.562340 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.562577 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.562822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.563061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.563294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.563528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:04.563709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 22 19:38:04.595376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.595837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.596035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.605485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.634905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.635376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.692075 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.743328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.743656 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.812756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.813052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.813213 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.813372 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.813592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.813792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.841682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.841902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.842183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.842408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.842650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.842806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.843022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.856072 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.869334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.869620 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.869761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.870730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.870730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.870730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.870730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:04.888546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.888875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 22 19:38:04.889090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.889268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 22 19:38:04.889543 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.889804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.890099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.890355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.901324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.901736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.902080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.902314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.910661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:04.914096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:04.914349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.914673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.914936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.915220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.915482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.915749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.916011 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.916282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.916561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.916925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.946388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.948095 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:04.948346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.950730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 22 19:38:04.950730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: from cryptography.utils import int_from_bytes Mar 22 19:38:04.951755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 22 19:38:04.951755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: from cryptography.utils import int_from_bytes Mar 22 19:38:04.957631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:04.958244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.958836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.969233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:04.969233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.973115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:04.973919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.974344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.974739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.975132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.975498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.975894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.976265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.996135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:04.996575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.000023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 22 19:38:05.000207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 22 19:38:05.000399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] command line args: [] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 22 19:38:05.000677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 22 19:38:05.000846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ================================================================================ {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 22 19:38:05.001095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] admin_token = **** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.001337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] config_dir = [] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.001520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.001699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] config_source = [] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.001875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] debug = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.002112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.002306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.002392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.002513 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.002771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.003014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.003240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] list_limit = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.003415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] log_config_append = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.003590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.003767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] log_dir = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.003940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] log_file = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.004177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.004422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.004665 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.004909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.005081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.005255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.005499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.005738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.005987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.006221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.006448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.006679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.006922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.007165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.007464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.007982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.008164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] publish_errors = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.008388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.008549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.008628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.008776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.009023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.009254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.009389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.009511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] standard_threads = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.009698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.009955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.010128 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.010300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] use_journal = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.010545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] use_json = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.010722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] use_stderr = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.010895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] use_syslog = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.011127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 22 19:38:05.011386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.011620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.011872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.012108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.012351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.012586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.012828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.013061 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.013305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.013546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.013793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.014053 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.014303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.014535 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.014777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.015020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.015254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.015506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.015757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.015999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.016231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.016481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.016743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.016988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.017235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.017463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.017690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.017916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.018140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.018270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.018412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.018776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.018870 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.019072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.019313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.019554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.019795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.020033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.020259 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.020496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.020816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.020928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.021159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.021384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.021609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.021839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.022105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.022339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.022553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.022777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.023006 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.023243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.023487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.023704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.023936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.024170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.024249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.024407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.024637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.024865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.025090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.025333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.025564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.025802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.026046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.026554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.026788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.026995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.027225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.027457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.027722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.027959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.028201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.028447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.028677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.028908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.029139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.029383 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.029552 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.029696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.029839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.030052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.030178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.030329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.030511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.030635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.030780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.030971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.031092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.031228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.031424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.031557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.031712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.031877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.032000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.032168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.032404 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.032700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.032868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.033099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.033325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.033550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.033776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.034036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.034251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.034491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.034721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.034961 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.035193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.035443 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.035696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.035930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.036156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] auth.external = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.036381 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.036675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.036903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.037132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] auth.password = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.037361 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] auth.token = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.037596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.037827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.038100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.038329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.038570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.038814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.039038 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.039268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] credential.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.039508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.039752 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.039992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.040222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.040459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.040686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.040945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.041190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.041422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.041670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.042039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.042285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.042544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.042780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.043026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.043254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] federation.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.043485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.043724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.043965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.044188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.044433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.044667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.044913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.045148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.045391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.045623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.045865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.046121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.046363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.046607 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.046835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.047064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.047304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.047529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.047761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.048003 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.048253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.048481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.048706 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.048931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.049170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.049579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.049827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.050108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.050352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.050625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.050860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.051094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.051321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.051555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.051782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.052013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.052252 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.052486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.052730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.052957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.053199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.053439 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.053670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.053910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.054171 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.054403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.054640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.054862 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.055100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.055326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.055568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.055799 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.056039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.056367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.056536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.056742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.056969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.057211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.057606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.057840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.058113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.058308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.058497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.058730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.058850 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.058982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.059191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.059314 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.059433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.059660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.059825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.059957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.060129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.060359 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.060583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.060813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.061041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.061273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.061499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.061739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.062000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.062247 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.062489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.062709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.062934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.063176 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.063408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.063637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.063870 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.064130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.064323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.064563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.064798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.065047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.065271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.065509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.065740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.066020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.066210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.066449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.066689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.066913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.067144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.067387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] resource.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.067632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.067875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.068113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.068351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.068594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.068830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.069071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.069353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.069525 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.069756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] role.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.070019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] role.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.070247 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.070492 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.070650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.070783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.070959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.071192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.071432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.071678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.071911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.072150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.072383 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.072623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.072858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.073051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.073195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.073424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.073608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.074038 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.074266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.074509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.074755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.075004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.075241 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.075471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.075719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.075971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.076204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.076430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.076651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.076876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.077121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.077377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.077618 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.077764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.077891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.078084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.078206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.078328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.078523 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] token.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.078679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.078834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.078996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.079115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.079237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.079434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.079588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.079759 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.079958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.080144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.080348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.080588 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.080815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.081045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.081273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.081511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.081776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.082194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.082321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.082501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.082766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.connection = **** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.083005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.083244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.083475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.083749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.083939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.084170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.084401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.084631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.084875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.085478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.085478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.085742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.085862 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.086033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.086265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.086490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.086724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.087256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 22 19:38:05.087256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 22 19:38:05.095245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.095615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.095971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.096319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.098180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.098930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.099275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.114447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.114727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.114863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.117571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.120968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.123756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.124410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.144367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.144705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.187841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.226647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.226967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.231757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.233536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.233896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.234259 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.241528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.243236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.246938 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.247308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.247657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.247997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.257123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.257510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.257871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.265912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.266285 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.266762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.267136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.267478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.267806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.268161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.268510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.268872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.269219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.269520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.269856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.270212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.270570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.272681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.272872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.273113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.273292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.273528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.273705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.287352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.287623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.287754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.287988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.288166 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.288359 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.288566 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.297139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.300788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.301009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.301232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.301448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.301690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.301868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.302077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 22 19:38:05.309996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561c031939c0 pid: 91344 (default app) Mar 22 19:38:05.313072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.313271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 22 19:38:05.313620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.313806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 22 19:38:05.314014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad8e39-3709-4588-a180-d4512a051746 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:05.314151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.314344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.314482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad8e39-3709-4588-a180-d4512a051746 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:05.314611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.314845 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.314991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad8e39-3709-4588-a180-d4512a051746 None None] PATH_INFO: `/v3` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:05.319863 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Tue Mar 22 19:38:05 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:05.326995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.327288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.327578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.327834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.336242 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.339845 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.340108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.340424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.340649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.340927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.341181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.341462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.341731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.342015 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.342299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.342557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.369259 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.371412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.371694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.377305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.377612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.377886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.386366 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.386677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.391426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.391725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.392004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.392283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.392595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.392875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.393152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.393645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.412677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.412979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.417894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.421673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.422037 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.429154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.433246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.437293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.437597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.437880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.438183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.438465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.438774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.472238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.472238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.472238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.472238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.472238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.481965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.481965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.481965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.481965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.482603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.482603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.483330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.498956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.499425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.499543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.499782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.500051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.500315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.500585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.527161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.531234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.534641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.536278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.538227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.538624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.538995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.546488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.548300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.551787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.552209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.552587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.552936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.562320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.562712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.563065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.571843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 22 19:38:05.572211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.572561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.572991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.573428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.573776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.574173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.574540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.574905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.575410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.575775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.576104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.576449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.576788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 22 19:38:05.615495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561c031939c0 pid: 91345 (default app) Mar 22 19:38:13.771506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caadbe1-1c1a-4e17-a72f-48a14d2874cf None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:13.772045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caadbe1-1c1a-4e17-a72f-48a14d2874cf None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:13.772045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caadbe1-1c1a-4e17-a72f-48a14d2874cf None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:13.774156 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:38:13.782597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:13.783075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:13.783255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:13.816322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG oslo_db.sqlalchemy.engines [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 22 19:38:14.127684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG passlib.handlers.bcrypt [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91345) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 22 19:38:14.128087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG passlib.handlers.bcrypt [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91345) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 22 19:38:14.186239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:14.187909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:14.348079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1/3] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 22 19:38:14.389522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caadbe1-1c1a-4e17-a72f-48a14d2874cf None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:14.425830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG oslo_db.sqlalchemy.engines [None req-9caadbe1-1c1a-4e17-a72f-48a14d2874cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 22 19:38:14.561055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caadbe1-1c1a-4e17-a72f-48a14d2874cf None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:14.565738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3690d-edd6-406b-afe7-3b84670fb452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:14.566456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3690d-edd6-406b-afe7-3b84670fb452 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:14.566731 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3690d-edd6-406b-afe7-3b84670fb452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:14.567005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3690d-edd6-406b-afe7-3b84670fb452 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:14.582484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3690d-edd6-406b-afe7-3b84670fb452 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:14.636654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ffa3690d-edd6-406b-afe7-3b84670fb452 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 22 19:38:14.636963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3690d-edd6-406b-afe7-3b84670fb452 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:14.647594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Mar 22 19:38:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 19:38:14.654766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:14.671243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12916-2fd8-4547-acea-5afc10be40e4 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:14.678301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426390-cf73-4667-a5ad-9ca9a9cadb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:14.680204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426390-cf73-4667-a5ad-9ca9a9cadb11 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:14.680672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426390-cf73-4667-a5ad-9ca9a9cadb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:14.681139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426390-cf73-4667-a5ad-9ca9a9cadb11 admin admin] PATH_INFO: `/v3/projects/9df87fda527d419183d70b258d3b9b6b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:14.684727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426390-cf73-4667-a5ad-9ca9a9cadb11 admin admin] RBAC: Authorizing `identity:get_project(project_id=9df87fda527d419183d70b258d3b9b6b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:14.793580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9d426390-cf73-4667-a5ad-9ca9a9cadb11 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 22 19:38:14.794346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426390-cf73-4667-a5ad-9ca9a9cadb11 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:14.803230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 2/5] 10.222.0.49 () {56 vars in 1207 bytes} [Tue Mar 22 19:38:14 2022] GET /identity/v3/projects/9df87fda527d419183d70b258d3b9b6b => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:17.264492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4b4b5-2356-4c9b-a7a7-994228cf4237 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:17.265042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4b4b5-2356-4c9b-a7a7-994228cf4237 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:17.265042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4b4b5-2356-4c9b-a7a7-994228cf4237 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:17.269628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 4/6] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:17.275765 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192725c1-3317-4e2d-bb56-f6dacf250b49 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:17.276353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192725c1-3317-4e2d-bb56-f6dacf250b49 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:17.276353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192725c1-3317-4e2d-bb56-f6dacf250b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:17.297447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-192725c1-3317-4e2d-bb56-f6dacf250b49 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:17.299026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-192725c1-3317-4e2d-bb56-f6dacf250b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:17.308466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 3/7] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 22 19:38:17.333225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4b4b5-2356-4c9b-a7a7-994228cf4237 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:17.346596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4b4b5-2356-4c9b-a7a7-994228cf4237 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:17.351300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b2e36-6581-49e9-9ded-eeab7c0f78f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:17.351954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b2e36-6581-49e9-9ded-eeab7c0f78f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:17.352236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b2e36-6581-49e9-9ded-eeab7c0f78f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:17.352508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b2e36-6581-49e9-9ded-eeab7c0f78f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:17.361184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b2e36-6581-49e9-9ded-eeab7c0f78f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:17.363035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b2e36-6581-49e9-9ded-eeab7c0f78f6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:17.372719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Mar 22 19:38:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 22 19:38:17.379048 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192725c1-3317-4e2d-bb56-f6dacf250b49 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:17.389337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192725c1-3317-4e2d-bb56-f6dacf250b49 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:17.394132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c4ae5-cae7-4cb0-9dc9-a961c8e3c127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:17.395106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c4ae5-cae7-4cb0-9dc9-a961c8e3c127 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:17.395432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c4ae5-cae7-4cb0-9dc9-a961c8e3c127 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:17.395761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c4ae5-cae7-4cb0-9dc9-a961c8e3c127 admin admin] PATH_INFO: `/v3/users/686bfe5266224121af654efbb4f624b9` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:17.397465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c4ae5-cae7-4cb0-9dc9-a961c8e3c127 admin admin] RBAC: Authorizing `identity:get_user(user_id=686bfe5266224121af654efbb4f624b9)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:17.399517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c4ae5-cae7-4cb0-9dc9-a961c8e3c127 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:17.401427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 4/9] 10.222.0.49 () {56 vars in 1198 bytes} [Tue Mar 22 19:38:17 2022] GET /identity/v3/users/686bfe5266224121af654efbb4f624b9 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:19.922976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074a61d-0385-448c-b3e2-54fcf19af377 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:19.923553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074a61d-0385-448c-b3e2-54fcf19af377 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:19.923553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074a61d-0385-448c-b3e2-54fcf19af377 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:19.925528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:38:19.932482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947aa4-7802-44fb-9ee6-1f0cfa365af4 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:19.933290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947aa4-7802-44fb-9ee6-1f0cfa365af4 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:19.933290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947aa4-7802-44fb-9ee6-1f0cfa365af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:19.939913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a47804-6fd2-4890-be5f-0d51d18c6026 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:19.940453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a47804-6fd2-4890-be5f-0d51d18c6026 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:19.940947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a47804-6fd2-4890-be5f-0d51d18c6026 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:19.943814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 7/11] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:38:19.953719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acbb05-ea9d-44a1-b295-0a4bfda98bd1 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:19.954221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acbb05-ea9d-44a1-b295-0a4bfda98bd1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:19.954658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acbb05-ea9d-44a1-b295-0a4bfda98bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:19.960014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-98947aa4-7802-44fb-9ee6-1f0cfa365af4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:19.961471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-98947aa4-7802-44fb-9ee6-1f0cfa365af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:20.003520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG passlib.handlers.bcrypt [None req-d2acbb05-ea9d-44a1-b295-0a4bfda98bd1 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91344) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 22 19:38:20.004206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG passlib.handlers.bcrypt [None req-d2acbb05-ea9d-44a1-b295-0a4bfda98bd1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91344) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 22 19:38:20.057754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d2acbb05-ea9d-44a1-b295-0a4bfda98bd1 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:20.060402 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d2acbb05-ea9d-44a1-b295-0a4bfda98bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:20.080417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 5/12] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:20.119693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947aa4-7802-44fb-9ee6-1f0cfa365af4 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:20.207347 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 8/13] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:20.248952 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acbb05-ea9d-44a1-b295-0a4bfda98bd1 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:20.293304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947aa4-7802-44fb-9ee6-1f0cfa365af4 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:20.348279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09570882-f8f4-4721-ab33-ec4198eb7261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:20.349589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09570882-f8f4-4721-ab33-ec4198eb7261 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:20.350148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09570882-f8f4-4721-ab33-ec4198eb7261 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:20.350552 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09570882-f8f4-4721-ab33-ec4198eb7261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:20.396390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acbb05-ea9d-44a1-b295-0a4bfda98bd1 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:20.439392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3545-fecf-4c22-a23d-abcae93351c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:20.440741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3545-fecf-4c22-a23d-abcae93351c0 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:20.441173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3545-fecf-4c22-a23d-abcae93351c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:20.441537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3545-fecf-4c22-a23d-abcae93351c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:20.459243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa3545-fecf-4c22-a23d-abcae93351c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:20.464179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09570882-f8f4-4721-ab33-ec4198eb7261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:20.466947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09570882-f8f4-4721-ab33-ec4198eb7261 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:20.471910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a0fa3545-fecf-4c22-a23d-abcae93351c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:38:20.473403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 9/14] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:38:20.480328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3545-fecf-4c22-a23d-abcae93351c0 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:20.589808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 6/15] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:38:20.596358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09570882-f8f4-4721-ab33-ec4198eb7261 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:20.610512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3545-fecf-4c22-a23d-abcae93351c0 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:20.649641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69029c16-41e1-4e2b-b29a-df41a5e80285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:20.650238 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69029c16-41e1-4e2b-b29a-df41a5e80285 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:20.650519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69029c16-41e1-4e2b-b29a-df41a5e80285 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:20.650794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69029c16-41e1-4e2b-b29a-df41a5e80285 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:20.651678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69029c16-41e1-4e2b-b29a-df41a5e80285 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:20.652019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69029c16-41e1-4e2b-b29a-df41a5e80285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:20.653538 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69029c16-41e1-4e2b-b29a-df41a5e80285 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:20.667691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 10/16] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:20.676140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69029c16-41e1-4e2b-b29a-df41a5e80285 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:20.726526 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09570882-f8f4-4721-ab33-ec4198eb7261 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:20.776674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8663777-7fe5-4004-80b9-f19f37c08729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:20.778116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8663777-7fe5-4004-80b9-f19f37c08729 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:20.778563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8663777-7fe5-4004-80b9-f19f37c08729 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:20.779011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8663777-7fe5-4004-80b9-f19f37c08729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:20.794634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8663777-7fe5-4004-80b9-f19f37c08729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:20.796650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8663777-7fe5-4004-80b9-f19f37c08729 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:20.825358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-f8663777-7fe5-4004-80b9-f19f37c08729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:38:20.827366 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 7/17] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:38:20.836205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8663777-7fe5-4004-80b9-f19f37c08729 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:20.844468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69029c16-41e1-4e2b-b29a-df41a5e80285 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:20.903150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135cbd3-8843-4831-aeeb-c2c57fd5bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:20.904291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135cbd3-8843-4831-aeeb-c2c57fd5bff8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:20.904542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135cbd3-8843-4831-aeeb-c2c57fd5bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:20.904967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135cbd3-8843-4831-aeeb-c2c57fd5bff8 None admin] PATH_INFO: `/v3/users/686bfe5266224121af654efbb4f624b9` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:20.907020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135cbd3-8843-4831-aeeb-c2c57fd5bff8 None admin] RBAC: Authorizing `identity:get_user(user_id=686bfe5266224121af654efbb4f624b9)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:20.908947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135cbd3-8843-4831-aeeb-c2c57fd5bff8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:20.911134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 11/18] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:20 2022] GET /identity/v3/users/686bfe5266224121af654efbb4f624b9 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:20.919585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135cbd3-8843-4831-aeeb-c2c57fd5bff8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:20.984234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8663777-7fe5-4004-80b9-f19f37c08729 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:21.037895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582281e6-6633-47cb-9e60-23082528f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:21.038730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582281e6-6633-47cb-9e60-23082528f84b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:21.039090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582281e6-6633-47cb-9e60-23082528f84b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:21.039451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582281e6-6633-47cb-9e60-23082528f84b None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:21.040332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582281e6-6633-47cb-9e60-23082528f84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:21.040729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582281e6-6633-47cb-9e60-23082528f84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:21.042565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582281e6-6633-47cb-9e60-23082528f84b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:21.057408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135cbd3-8843-4831-aeeb-c2c57fd5bff8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:21.064935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 8/19] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:21.105288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c6274-01f0-4e54-a73e-627e4577ff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:21.106259 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c6274-01f0-4e54-a73e-627e4577ff75 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:21.106607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c6274-01f0-4e54-a73e-627e4577ff75 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:21.106990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c6274-01f0-4e54-a73e-627e4577ff75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:21.108500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c6274-01f0-4e54-a73e-627e4577ff75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:21.110176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c6274-01f0-4e54-a73e-627e4577ff75 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:21.111965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 12/20] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:21.122656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582281e6-6633-47cb-9e60-23082528f84b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:21.252578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582281e6-6633-47cb-9e60-23082528f84b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:21.294359 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7e6a5-6b5a-4a36-be36-57e2f9b738e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:21.295366 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7e6a5-6b5a-4a36-be36-57e2f9b738e6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:21.295746 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7e6a5-6b5a-4a36-be36-57e2f9b738e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:21.296174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7e6a5-6b5a-4a36-be36-57e2f9b738e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:21.297455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7e6a5-6b5a-4a36-be36-57e2f9b738e6 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.domain.id=default, user.id=686bfe5266224121af654efbb4f624b9) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:21.297924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7e6a5-6b5a-4a36-be36-57e2f9b738e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:21.299980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7e6a5-6b5a-4a36-be36-57e2f9b738e6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:21.309818 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 9/21] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Mar 22 19:38:21 2022] GET /identity/v3/role_assignments?user.id=686bfe5266224121af654efbb4f624b9&scope.domain.id=default&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 233 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:24.262466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8580c6-2212-4315-856a-41c281f7d3e0 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:24.262974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8580c6-2212-4315-856a-41c281f7d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:24.263399 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8580c6-2212-4315-856a-41c281f7d3e0 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:24.267465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 13/22] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:24.277087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e62944-b3bf-4f7d-8189-178248957338 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:24.277579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e62944-b3bf-4f7d-8189-178248957338 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:24.278113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e62944-b3bf-4f7d-8189-178248957338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:24.318293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-06e62944-b3bf-4f7d-8189-178248957338 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:24.320325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-06e62944-b3bf-4f7d-8189-178248957338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:24.473243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 10/23] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:24.548718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8580c6-2212-4315-856a-41c281f7d3e0 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:24.699889 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8580c6-2212-4315-856a-41c281f7d3e0 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:24.753456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fad51-2d04-4fe5-8308-45a31159ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:24.753456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fad51-2d04-4fe5-8308-45a31159ab08 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:24.753829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fad51-2d04-4fe5-8308-45a31159ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:24.754028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fad51-2d04-4fe5-8308-45a31159ab08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:24.782632 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fad51-2d04-4fe5-8308-45a31159ab08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:24.789644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-f32fad51-2d04-4fe5-8308-45a31159ab08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:38:24.790942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 14/24] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:24.801055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e62944-b3bf-4f7d-8189-178248957338 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:25.023858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e62944-b3bf-4f7d-8189-178248957338 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:25.091600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257960d9-67fe-4e66-b660-c087a4b3c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:25.092775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257960d9-67fe-4e66-b660-c087a4b3c018 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:25.093265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257960d9-67fe-4e66-b660-c087a4b3c018 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:25.093740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257960d9-67fe-4e66-b660-c087a4b3c018 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:25.095194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257960d9-67fe-4e66-b660-c087a4b3c018 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:25.095738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257960d9-67fe-4e66-b660-c087a4b3c018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:25.098348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257960d9-67fe-4e66-b660-c087a4b3c018 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:25.124384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 11/25] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:25.131645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fad51-2d04-4fe5-8308-45a31159ab08 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:25.326111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fad51-2d04-4fe5-8308-45a31159ab08 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:25.400074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3e0e4-6207-4449-8098-1e0921159238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:25.401755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3e0e4-6207-4449-8098-1e0921159238 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:25.402281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3e0e4-6207-4449-8098-1e0921159238 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:25.402776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3e0e4-6207-4449-8098-1e0921159238 None admin] PATH_INFO: `/v3/users/686bfe5266224121af654efbb4f624b9` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:25.406864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3e0e4-6207-4449-8098-1e0921159238 None admin] RBAC: Authorizing `identity:get_user(user_id=686bfe5266224121af654efbb4f624b9)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:25.408524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3e0e4-6207-4449-8098-1e0921159238 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:25.410685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 15/26] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:25 2022] GET /identity/v3/users/686bfe5266224121af654efbb4f624b9 => generated 247 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:25.419808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257960d9-67fe-4e66-b660-c087a4b3c018 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:25.623328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257960d9-67fe-4e66-b660-c087a4b3c018 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:25.691922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ab0a2-c911-40f9-80bd-485a4bffc30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:25.693281 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ab0a2-c911-40f9-80bd-485a4bffc30d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:25.693802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ab0a2-c911-40f9-80bd-485a4bffc30d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:25.694304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ab0a2-c911-40f9-80bd-485a4bffc30d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:25.699273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ab0a2-c911-40f9-80bd-485a4bffc30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:25.701925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ab0a2-c911-40f9-80bd-485a4bffc30d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:25.705021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 12/27] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:25.711209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3e0e4-6207-4449-8098-1e0921159238 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:25.893636 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3e0e4-6207-4449-8098-1e0921159238 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:25.951981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f4f7a-3f51-4722-8a73-6943f00b6c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:25.952809 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f4f7a-3f51-4722-8a73-6943f00b6c33 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:25.953083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f4f7a-3f51-4722-8a73-6943f00b6c33 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:25.953360 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f4f7a-3f51-4722-8a73-6943f00b6c33 None admin] PATH_INFO: `/v3/domains/default/users/686bfe5266224121af654efbb4f624b9/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:25.955730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f4f7a-3f51-4722-8a73-6943f00b6c33 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=686bfe5266224121af654efbb4f624b9, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:25.957257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f4f7a-3f51-4722-8a73-6943f00b6c33 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:26.002104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf0c51-c0eb-4afc-ab4e-f4a0a7034a79 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:26.002609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf0c51-c0eb-4afc-ab4e-f4a0a7034a79 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:26.003098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf0c51-c0eb-4afc-ab4e-f4a0a7034a79 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:26.011617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 13/28] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:26.020825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54610a31-2b3e-4399-a0f8-723dd55c4e7b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:26.021332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54610a31-2b3e-4399-a0f8-723dd55c4e7b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:26.026304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54610a31-2b3e-4399-a0f8-723dd55c4e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:26.071704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-54610a31-2b3e-4399-a0f8-723dd55c4e7b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:26.073849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-54610a31-2b3e-4399-a0f8-723dd55c4e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:26.101325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 16/29] 10.222.0.49 () {58 vars in 1361 bytes} [Tue Mar 22 19:38:25 2022] PUT /identity/v3/domains/default/users/686bfe5266224121af654efbb4f624b9/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:38:26.107306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711162-ffae-45b2-bc31-01382166def2 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:26.107724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711162-ffae-45b2-bc31-01382166def2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:26.107979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711162-ffae-45b2-bc31-01382166def2 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:26.113092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 17/30] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:26.121358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c9a0-5c72-4aad-8c4f-daabeb34ca4a None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:26.121738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c9a0-5c72-4aad-8c4f-daabeb34ca4a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:26.121995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c9a0-5c72-4aad-8c4f-daabeb34ca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:26.152512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-f8f5c9a0-5c72-4aad-8c4f-daabeb34ca4a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:26.154271 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f8f5c9a0-5c72-4aad-8c4f-daabeb34ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:26.290577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 14/31] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:26.329672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 18/32] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:26.370411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54610a31-2b3e-4399-a0f8-723dd55c4e7b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:26.412421 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5c9a0-5c72-4aad-8c4f-daabeb34ca4a None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:26.594902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54610a31-2b3e-4399-a0f8-723dd55c4e7b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:26.636986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5c9a0-5c72-4aad-8c4f-daabeb34ca4a None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:26.669640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572652b-5d4a-4767-ad96-16707653e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:26.671403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572652b-5d4a-4767-ad96-16707653e74c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:26.671945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572652b-5d4a-4767-ad96-16707653e74c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:26.672467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572652b-5d4a-4767-ad96-16707653e74c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:26.687109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30842133-34ee-4701-9486-25e01e4746e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:26.687804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30842133-34ee-4701-9486-25e01e4746e5 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:26.688088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30842133-34ee-4701-9486-25e01e4746e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:26.688370 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30842133-34ee-4701-9486-25e01e4746e5 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:26.689158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30842133-34ee-4701-9486-25e01e4746e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:26.690761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30842133-34ee-4701-9486-25e01e4746e5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:26.701663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572652b-5d4a-4767-ad96-16707653e74c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:26.703323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572652b-5d4a-4767-ad96-16707653e74c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:26.719888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 19/33] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Mar 22 19:38:26 2022] POST /identity/v3/roles => generated 219 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:38:26.721278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c23c5-ecc0-45ec-80e8-e0fe68f40ebf None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:26.721587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c23c5-ecc0-45ec-80e8-e0fe68f40ebf None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:26.721830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c23c5-ecc0-45ec-80e8-e0fe68f40ebf None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:26.723909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 20/34] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:26.731248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52909de-1543-44bb-b711-409f63cec353 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:26.731651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52909de-1543-44bb-b711-409f63cec353 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:26.731919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52909de-1543-44bb-b711-409f63cec353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:26.739657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-d572652b-5d4a-4767-ad96-16707653e74c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:38:26.741458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 15/35] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:26.752102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572652b-5d4a-4767-ad96-16707653e74c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:26.771104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c52909de-1543-44bb-b711-409f63cec353 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:26.772391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c52909de-1543-44bb-b711-409f63cec353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:27.006812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 21/36] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:27.038568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572652b-5d4a-4767-ad96-16707653e74c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:27.067516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe640f6-a9f1-4455-8713-ca4d784e5301 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:27.067913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe640f6-a9f1-4455-8713-ca4d784e5301 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:27.068092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe640f6-a9f1-4455-8713-ca4d784e5301 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:27.070244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 22/37] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:38:27.076544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c250f-2936-4574-972d-61af5b594210 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:27.077071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c250f-2936-4574-972d-61af5b594210 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:27.077367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c250f-2936-4574-972d-61af5b594210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:27.106326 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-f43c250f-2936-4574-972d-61af5b594210 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:27.107467 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f43c250f-2936-4574-972d-61af5b594210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:27.111313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce955103-ce95-40e4-b6cf-bdb85a4f511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:27.111313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce955103-ce95-40e4-b6cf-bdb85a4f511f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:27.111313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce955103-ce95-40e4-b6cf-bdb85a4f511f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:27.111313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce955103-ce95-40e4-b6cf-bdb85a4f511f None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:27.118964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce955103-ce95-40e4-b6cf-bdb85a4f511f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:27.118964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce955103-ce95-40e4-b6cf-bdb85a4f511f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:27.118964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce955103-ce95-40e4-b6cf-bdb85a4f511f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:27.145715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 16/38] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:27.146879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce955103-ce95-40e4-b6cf-bdb85a4f511f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:27.232729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 23/39] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:27.233817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c250f-2936-4574-972d-61af5b594210 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:27.334513 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce955103-ce95-40e4-b6cf-bdb85a4f511f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:27.348903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c250f-2936-4574-972d-61af5b594210 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:27.396057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2da34-e42a-42d8-aea7-f55310edb66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:27.397030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2da34-e42a-42d8-aea7-f55310edb66c None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:27.397465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2da34-e42a-42d8-aea7-f55310edb66c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:27.397888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2da34-e42a-42d8-aea7-f55310edb66c None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:27.398832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2da34-e42a-42d8-aea7-f55310edb66c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:27.400883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2da34-e42a-42d8-aea7-f55310edb66c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:27.408901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598e17f-3ec3-47f3-8bab-59bc3d0e4be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:27.410374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e17f-3ec3-47f3-8bab-59bc3d0e4be4 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:27.410555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e17f-3ec3-47f3-8bab-59bc3d0e4be4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:27.411016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598e17f-3ec3-47f3-8bab-59bc3d0e4be4 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:27.412519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598e17f-3ec3-47f3-8bab-59bc3d0e4be4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:27.415545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598e17f-3ec3-47f3-8bab-59bc3d0e4be4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:27.464738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 24/40] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:38:27 2022] POST /identity/v3/projects => generated 301 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:38:27.466471 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2da34-e42a-42d8-aea7-f55310edb66c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:27.674816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 17/41] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Mar 22 19:38:27 2022] POST /identity/v3/roles => generated 225 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:38:27.699188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2da34-e42a-42d8-aea7-f55310edb66c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:27.740712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da3157-f848-412e-ab8a-84683efb2253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:27.741512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da3157-f848-412e-ab8a-84683efb2253 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:27.741807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da3157-f848-412e-ab8a-84683efb2253 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:27.742109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da3157-f848-412e-ab8a-84683efb2253 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:27.743035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da3157-f848-412e-ab8a-84683efb2253 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:27.744649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da3157-f848-412e-ab8a-84683efb2253 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:27.761635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 25/42] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Mar 22 19:38:27 2022] POST /identity/v3/roles => generated 223 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:38:28.118573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525ba9-122b-41ff-9fe7-49e74faab1e8 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:28.119092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525ba9-122b-41ff-9fe7-49e74faab1e8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:28.119695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525ba9-122b-41ff-9fe7-49e74faab1e8 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:28.123310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 18/43] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:28.129125 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8910-1024-4898-b7c4-06d738f0eacd None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:28.129501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8910-1024-4898-b7c4-06d738f0eacd None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:28.129852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a8910-1024-4898-b7c4-06d738f0eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:28.148536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-369a8910-1024-4898-b7c4-06d738f0eacd None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:28.149892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-369a8910-1024-4898-b7c4-06d738f0eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:28.233109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 26/44] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:28.256334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525ba9-122b-41ff-9fe7-49e74faab1e8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:28.367604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525ba9-122b-41ff-9fe7-49e74faab1e8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:28.404193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2278a-6e13-4e74-a7a1-44496e4f1d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:28.404946 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2278a-6e13-4e74-a7a1-44496e4f1d45 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:28.405228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2278a-6e13-4e74-a7a1-44496e4f1d45 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:28.405498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2278a-6e13-4e74-a7a1-44496e4f1d45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:28.406889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2278a-6e13-4e74-a7a1-44496e4f1d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:28.408546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2278a-6e13-4e74-a7a1-44496e4f1d45 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:28.410256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 19/45] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:28.417015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8910-1024-4898-b7c4-06d738f0eacd None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:28.525912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a8910-1024-4898-b7c4-06d738f0eacd None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:28.564991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650c389-6380-47e2-87ae-b8148ad20cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:28.565804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c389-6380-47e2-87ae-b8148ad20cb2 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:28.566188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c389-6380-47e2-87ae-b8148ad20cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:28.566547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c389-6380-47e2-87ae-b8148ad20cb2 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:28.567376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650c389-6380-47e2-87ae-b8148ad20cb2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:28.568964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650c389-6380-47e2-87ae-b8148ad20cb2 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:28.609995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 27/46] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:38:28 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:38:29.493750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404dcd0-027a-4350-ab56-66b8c5cef3b8 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:29.494583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404dcd0-027a-4350-ab56-66b8c5cef3b8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:29.494583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404dcd0-027a-4350-ab56-66b8c5cef3b8 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:29.496372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 20/47] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:29.503451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaf86c-eb94-4013-aaa6-e7693873d61c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:29.503984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaf86c-eb94-4013-aaa6-e7693873d61c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:29.504586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaf86c-eb94-4013-aaa6-e7693873d61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:29.535109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9edaf86c-eb94-4013-aaa6-e7693873d61c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:29.537148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9edaf86c-eb94-4013-aaa6-e7693873d61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:29.647129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 28/48] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:29.671663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404dcd0-027a-4350-ab56-66b8c5cef3b8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:29.798292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404dcd0-027a-4350-ab56-66b8c5cef3b8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:29.837788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63928e3d-7ed2-442b-b2b1-6753e3402700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:29.838741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63928e3d-7ed2-442b-b2b1-6753e3402700 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:29.839687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63928e3d-7ed2-442b-b2b1-6753e3402700 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:29.839687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63928e3d-7ed2-442b-b2b1-6753e3402700 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:29.853229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63928e3d-7ed2-442b-b2b1-6753e3402700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:29.860453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-63928e3d-7ed2-442b-b2b1-6753e3402700 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:38:29.861712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 21/49] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:29.867647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaf86c-eb94-4013-aaa6-e7693873d61c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:29.969336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaf86c-eb94-4013-aaa6-e7693873d61c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:30.012186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1775-a23c-442e-b947-e30a6ef64168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:30.013214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1775-a23c-442e-b947-e30a6ef64168 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:30.013214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1775-a23c-442e-b947-e30a6ef64168 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:30.013444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f1775-a23c-442e-b947-e30a6ef64168 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:30.014217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f1775-a23c-442e-b947-e30a6ef64168 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:30.014527 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f1775-a23c-442e-b947-e30a6ef64168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:30.015956 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f1775-a23c-442e-b947-e30a6ef64168 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:30.025699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 29/50] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:30.031511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63928e3d-7ed2-442b-b2b1-6753e3402700 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:30.150167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63928e3d-7ed2-442b-b2b1-6753e3402700 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:30.197024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f02e0-f968-4ad1-b6a7-4fc722db81d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:30.198086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f02e0-f968-4ad1-b6a7-4fc722db81d4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:30.198374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f02e0-f968-4ad1-b6a7-4fc722db81d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:30.198656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f02e0-f968-4ad1-b6a7-4fc722db81d4 None admin] PATH_INFO: `/v3/users/686bfe5266224121af654efbb4f624b9` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:30.200141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f02e0-f968-4ad1-b6a7-4fc722db81d4 None admin] RBAC: Authorizing `identity:get_user(user_id=686bfe5266224121af654efbb4f624b9)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:30.201643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f02e0-f968-4ad1-b6a7-4fc722db81d4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:30.203462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 22/51] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:30 2022] GET /identity/v3/users/686bfe5266224121af654efbb4f624b9 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:30.209262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1775-a23c-442e-b947-e30a6ef64168 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:30.346178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f1775-a23c-442e-b947-e30a6ef64168 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:30.383248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2445da-b754-42a2-a8db-468275b9212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:30.384158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2445da-b754-42a2-a8db-468275b9212e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:30.384512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2445da-b754-42a2-a8db-468275b9212e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:30.384851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2445da-b754-42a2-a8db-468275b9212e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:30.386310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2445da-b754-42a2-a8db-468275b9212e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:30.387887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2445da-b754-42a2-a8db-468275b9212e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:30.389603 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 30/52] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:30.395819 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f02e0-f968-4ad1-b6a7-4fc722db81d4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:30.509914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f02e0-f968-4ad1-b6a7-4fc722db81d4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:30.549134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021863f-ee66-4341-96c0-ecb477794603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:30.549840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021863f-ee66-4341-96c0-ecb477794603 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:30.550149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021863f-ee66-4341-96c0-ecb477794603 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:30.550421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021863f-ee66-4341-96c0-ecb477794603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:30.551272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021863f-ee66-4341-96c0-ecb477794603 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.domain.id=default, user.id=686bfe5266224121af654efbb4f624b9) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:30.551579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021863f-ee66-4341-96c0-ecb477794603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:30.553091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021863f-ee66-4341-96c0-ecb477794603 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:30.560326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 23/53] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Mar 22 19:38:30 2022] GET /identity/v3/role_assignments?user.id=686bfe5266224121af654efbb4f624b9&scope.domain.id=default&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 530 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:31.472599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2336baf-a285-485a-b615-25fa18faf3d2 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:31.473172 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2336baf-a285-485a-b615-25fa18faf3d2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:31.473919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2336baf-a285-485a-b615-25fa18faf3d2 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:31.477498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 31/54] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:31.484538 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c82848-bfce-4a18-9b33-ad69f4a4af9a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:31.484802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c82848-bfce-4a18-9b33-ad69f4a4af9a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:31.485097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c82848-bfce-4a18-9b33-ad69f4a4af9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:31.504334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-62c82848-bfce-4a18-9b33-ad69f4a4af9a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:31.505971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-62c82848-bfce-4a18-9b33-ad69f4a4af9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:31.580884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 24/55] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:31.605430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2336baf-a285-485a-b615-25fa18faf3d2 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:31.730197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2336baf-a285-485a-b615-25fa18faf3d2 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:31.768259 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2ce77-e3bc-4717-97ed-dd605103367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:31.769070 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2ce77-e3bc-4717-97ed-dd605103367d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:31.769449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2ce77-e3bc-4717-97ed-dd605103367d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:31.769727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2ce77-e3bc-4717-97ed-dd605103367d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:31.771105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2ce77-e3bc-4717-97ed-dd605103367d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:31.772617 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2ce77-e3bc-4717-97ed-dd605103367d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:31.774301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 32/56] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:31.780500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c82848-bfce-4a18-9b33-ad69f4a4af9a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:31.910597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c82848-bfce-4a18-9b33-ad69f4a4af9a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:31.976370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff271-6e25-41b6-b904-d5a2d2ab5bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:31.977061 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff271-6e25-41b6-b904-d5a2d2ab5bc1 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:31.977349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff271-6e25-41b6-b904-d5a2d2ab5bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:31.977616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff271-6e25-41b6-b904-d5a2d2ab5bc1 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:31.978413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff271-6e25-41b6-b904-d5a2d2ab5bc1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:31.981555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff271-6e25-41b6-b904-d5a2d2ab5bc1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:32.016990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 25/57] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Mar 22 19:38:31 2022] POST /identity/v3/projects => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:38:34.551134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dc816-d8a8-42bc-8fe3-07c95a1ad5fc None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:34.551712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dc816-d8a8-42bc-8fe3-07c95a1ad5fc None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:34.551712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dc816-d8a8-42bc-8fe3-07c95a1ad5fc None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:34.553437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 33/58] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:38:34.559558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c95d3-bc2c-4f4d-80ec-3ec116995dcd None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:34.560105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c95d3-bc2c-4f4d-80ec-3ec116995dcd None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:34.560105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c95d3-bc2c-4f4d-80ec-3ec116995dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:34.578501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-908c95d3-bc2c-4f4d-80ec-3ec116995dcd None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:34.579716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-908c95d3-bc2c-4f4d-80ec-3ec116995dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:34.651660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 26/59] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:34.676955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dc816-d8a8-42bc-8fe3-07c95a1ad5fc None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:34.787402 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dc816-d8a8-42bc-8fe3-07c95a1ad5fc None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:34.824692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252e5c7-2155-46e3-821d-3e993e43677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:34.825550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252e5c7-2155-46e3-821d-3e993e43677a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:34.825892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252e5c7-2155-46e3-821d-3e993e43677a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:34.826257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252e5c7-2155-46e3-821d-3e993e43677a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:34.827549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252e5c7-2155-46e3-821d-3e993e43677a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:34.829073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252e5c7-2155-46e3-821d-3e993e43677a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:34.830940 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 34/60] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:34.837482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c95d3-bc2c-4f4d-80ec-3ec116995dcd None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:34.944536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c95d3-bc2c-4f4d-80ec-3ec116995dcd None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:34.981871 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860f648-b7ca-42b8-b9b2-da57da9a4e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:34.982653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f648-b7ca-42b8-b9b2-da57da9a4e40 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:34.982938 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f648-b7ca-42b8-b9b2-da57da9a4e40 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:34.983211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f648-b7ca-42b8-b9b2-da57da9a4e40 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:34.983926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860f648-b7ca-42b8-b9b2-da57da9a4e40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:34.985407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860f648-b7ca-42b8-b9b2-da57da9a4e40 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:35.019729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 27/61] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:38:34 2022] POST /identity/v3/users => generated 275 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:38:39.047357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe7f70-e718-44c3-8ea6-fd397fb980ce None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:39.048391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe7f70-e718-44c3-8ea6-fd397fb980ce None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:39.049331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe7f70-e718-44c3-8ea6-fd397fb980ce None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:39.051838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 35/62] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:39.068186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85709c7-03ed-46cb-830a-064c21d5da78 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:39.069052 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85709c7-03ed-46cb-830a-064c21d5da78 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:39.069496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85709c7-03ed-46cb-830a-064c21d5da78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:39.093611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a85709c7-03ed-46cb-830a-064c21d5da78 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:39.095234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a85709c7-03ed-46cb-830a-064c21d5da78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:39.192092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 28/63] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:39.267649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe7f70-e718-44c3-8ea6-fd397fb980ce None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:39.407569 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe7f70-e718-44c3-8ea6-fd397fb980ce None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:39.457148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd56b0-62ea-4078-aa1f-73520dd9fb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:39.458395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd56b0-62ea-4078-aa1f-73520dd9fb1b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:39.458865 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd56b0-62ea-4078-aa1f-73520dd9fb1b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:39.459310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd56b0-62ea-4078-aa1f-73520dd9fb1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:39.483217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd56b0-62ea-4078-aa1f-73520dd9fb1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:39.490829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-6abd56b0-62ea-4078-aa1f-73520dd9fb1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:38:39.492717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 36/64] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:39.501369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85709c7-03ed-46cb-830a-064c21d5da78 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:39.544567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7549-c418-442e-af7e-fa3beff0f432 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:39.544938 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7549-c418-442e-af7e-fa3beff0f432 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:39.545144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7549-c418-442e-af7e-fa3beff0f432 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:39.547152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 37/65] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:38:39.562795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05869c-346a-4790-b10e-bfe4ab64b991 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:39.563484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05869c-346a-4790-b10e-bfe4ab64b991 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:39.563972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05869c-346a-4790-b10e-bfe4ab64b991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:39.594559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-ef05869c-346a-4790-b10e-bfe4ab64b991 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:39.596477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ef05869c-346a-4790-b10e-bfe4ab64b991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:39.634659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85709c7-03ed-46cb-830a-064c21d5da78 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:39.681383 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f27c2-0b8d-43af-9562-060e2b44ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:39.682112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f27c2-0b8d-43af-9562-060e2b44ca7a None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:39.682399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f27c2-0b8d-43af-9562-060e2b44ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:39.682676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f27c2-0b8d-43af-9562-060e2b44ca7a None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:39.683462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f27c2-0b8d-43af-9562-060e2b44ca7a None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:39.683770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f27c2-0b8d-43af-9562-060e2b44ca7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:39.685238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f27c2-0b8d-43af-9562-060e2b44ca7a None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:39.712060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 29/66] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:38:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:39.718345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f27c2-0b8d-43af-9562-060e2b44ca7a None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:39.760916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 38/67] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:39.796290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05869c-346a-4790-b10e-bfe4ab64b991 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:39.874786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f27c2-0b8d-43af-9562-060e2b44ca7a None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:39.943836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c798d28-4753-425f-b0b5-812e992a1d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:39.945855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c798d28-4753-425f-b0b5-812e992a1d75 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:39.946699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c798d28-4753-425f-b0b5-812e992a1d75 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:39.947610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c798d28-4753-425f-b0b5-812e992a1d75 None admin] PATH_INFO: `/v3/users/0c7219524d1b4afd8d1aea23de18a164` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:39.954406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05869c-346a-4790-b10e-bfe4ab64b991 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:39.976646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c798d28-4753-425f-b0b5-812e992a1d75 None admin] RBAC: Authorizing `identity:get_user(user_id=0c7219524d1b4afd8d1aea23de18a164)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:39.981255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c798d28-4753-425f-b0b5-812e992a1d75 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:39.985044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 30/68] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:39 2022] GET /identity/v3/users/0c7219524d1b4afd8d1aea23de18a164 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:39.994119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c798d28-4753-425f-b0b5-812e992a1d75 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:40.021804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b30a59-c7c4-4698-8269-420d9191322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:40.023786 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30a59-c7c4-4698-8269-420d9191322e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.024590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30a59-c7c4-4698-8269-420d9191322e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.025373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30a59-c7c4-4698-8269-420d9191322e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.064346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b30a59-c7c4-4698-8269-420d9191322e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:40.079944 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-89b30a59-c7c4-4698-8269-420d9191322e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:38:40.083054 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 39/69] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:40.091936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b30a59-c7c4-4698-8269-420d9191322e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:40.169446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c798d28-4753-425f-b0b5-812e992a1d75 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:40.219394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a808db-5c0b-4d12-a9b6-14b236123e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:40.220084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a808db-5c0b-4d12-a9b6-14b236123e33 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.220491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a808db-5c0b-4d12-a9b6-14b236123e33 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.220897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a808db-5c0b-4d12-a9b6-14b236123e33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.278369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b30a59-c7c4-4698-8269-420d9191322e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:40.297423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a808db-5c0b-4d12-a9b6-14b236123e33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:40.298976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a808db-5c0b-4d12-a9b6-14b236123e33 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:40.337051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2551d24-3114-4b22-99d5-7854568e48e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:40.338331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2551d24-3114-4b22-99d5-7854568e48e7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.338843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2551d24-3114-4b22-99d5-7854568e48e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.339553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2551d24-3114-4b22-99d5-7854568e48e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.340932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2551d24-3114-4b22-99d5-7854568e48e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:40.341468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2551d24-3114-4b22-99d5-7854568e48e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:40.344149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2551d24-3114-4b22-99d5-7854568e48e7 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:40.361214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 40/70] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:40.363682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6364d-7679-4418-9a48-de72d169a56d None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.364174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6364d-7679-4418-9a48-de72d169a56d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.364675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6364d-7679-4418-9a48-de72d169a56d None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.368116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 41/71] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:40.369860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039246b-95ac-484c-be3f-b11d62ee6be0 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.370180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039246b-95ac-484c-be3f-b11d62ee6be0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.370465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039246b-95ac-484c-be3f-b11d62ee6be0 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.372223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 42/72] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:40.373410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01909ce5-8757-4b21-92ac-d2da1523c7b0 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.373700 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01909ce5-8757-4b21-92ac-d2da1523c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.374010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01909ce5-8757-4b21-92ac-d2da1523c7b0 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.375955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 43/73] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:40.376464 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01909ce5-8757-4b21-92ac-d2da1523c7b0 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:40.415938 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 31/74] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:38:40.417841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc626-8b8e-43f5-9992-3a093548b5a0 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.418202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc626-8b8e-43f5-9992-3a093548b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.418487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8dc626-8b8e-43f5-9992-3a093548b5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.435631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6b8dc626-8b8e-43f5-9992-3a093548b5a0 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:40.436849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6b8dc626-8b8e-43f5-9992-3a093548b5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:40.504601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01909ce5-8757-4b21-92ac-d2da1523c7b0 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:40.520364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 32/75] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:40.522851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266848c3-c103-4b61-81ef-667205886874 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.523216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266848c3-c103-4b61-81ef-667205886874 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.523503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266848c3-c103-4b61-81ef-667205886874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.546353 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3521c-bc41-4133-b4c7-2a4339612fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:40.547304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3521c-bc41-4133-b4c7-2a4339612fea None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.547588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3521c-bc41-4133-b4c7-2a4339612fea None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.547864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3521c-bc41-4133-b4c7-2a4339612fea None admin] PATH_INFO: `/v3/users/686bfe5266224121af654efbb4f624b9` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.548912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-266848c3-c103-4b61-81ef-667205886874 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:40.549140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3521c-bc41-4133-b4c7-2a4339612fea None admin] RBAC: Authorizing `identity:get_user(user_id=686bfe5266224121af654efbb4f624b9)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:40.550752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3521c-bc41-4133-b4c7-2a4339612fea None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:40.551060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-266848c3-c103-4b61-81ef-667205886874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:40.558332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 44/76] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:40 2022] GET /identity/v3/users/686bfe5266224121af654efbb4f624b9 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:40.558332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1612-dd7b-48a9-96d4-39f8060f4b0b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.558332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1612-dd7b-48a9-96d4-39f8060f4b0b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.558332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1612-dd7b-48a9-96d4-39f8060f4b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.572618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-e01f1612-dd7b-48a9-96d4-39f8060f4b0b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:40.573870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e01f1612-dd7b-48a9-96d4-39f8060f4b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:40.643094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 33/77] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:40.644550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266848c3-c103-4b61-81ef-667205886874 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:40.667016 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 45/78] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:40.667016 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f1612-dd7b-48a9-96d4-39f8060f4b0b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:40.768427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266848c3-c103-4b61-81ef-667205886874 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:40.781009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f1612-dd7b-48a9-96d4-39f8060f4b0b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:40.803724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234aea5-604e-47fb-b5f2-4aa2f0c93709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:40.804703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234aea5-604e-47fb-b5f2-4aa2f0c93709 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.805009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234aea5-604e-47fb-b5f2-4aa2f0c93709 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.806063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234aea5-604e-47fb-b5f2-4aa2f0c93709 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.806653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234aea5-604e-47fb-b5f2-4aa2f0c93709 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:40.808565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234aea5-604e-47fb-b5f2-4aa2f0c93709 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:40.810488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 34/79] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:40 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:40.811282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234aea5-604e-47fb-b5f2-4aa2f0c93709 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:40.817839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1c7d3-fd07-4fac-98b0-2cb3cdf08661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:40.818775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1c7d3-fd07-4fac-98b0-2cb3cdf08661 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.819148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1c7d3-fd07-4fac-98b0-2cb3cdf08661 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.819503 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1c7d3-fd07-4fac-98b0-2cb3cdf08661 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.821069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1c7d3-fd07-4fac-98b0-2cb3cdf08661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:40.823189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1c7d3-fd07-4fac-98b0-2cb3cdf08661 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:40.825117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 46/80] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:40.825910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1c7d3-fd07-4fac-98b0-2cb3cdf08661 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:40.926509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234aea5-604e-47fb-b5f2-4aa2f0c93709 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:40.939614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1c7d3-fd07-4fac-98b0-2cb3cdf08661 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:40.968854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b8731-a690-4086-80d2-a9d3d6071501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:40.969917 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b8731-a690-4086-80d2-a9d3d6071501 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.970406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b8731-a690-4086-80d2-a9d3d6071501 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.970850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b8731-a690-4086-80d2-a9d3d6071501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:40.989187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa21f4-9f20-44fa-9d8e-a42353624cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:40.990512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa21f4-9f20-44fa-9d8e-a42353624cce None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:40.990977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa21f4-9f20-44fa-9d8e-a42353624cce None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:40.991418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa21f4-9f20-44fa-9d8e-a42353624cce None admin] PATH_INFO: `/v3/roles/member` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:41.008995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa21f4-9f20-44fa-9d8e-a42353624cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:41.021783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-68fa21f4-9f20-44fa-9d8e-a42353624cce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:38:41.029243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 47/81] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:41.029243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa21f4-9f20-44fa-9d8e-a42353624cce None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:41.081743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b8731-a690-4086-80d2-a9d3d6071501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:41.083918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b8731-a690-4086-80d2-a9d3d6071501 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:41.177704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa21f4-9f20-44fa-9d8e-a42353624cce None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:41.200776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 35/82] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:38:41.203172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b8731-a690-4086-80d2-a9d3d6071501 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:41.231065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7ba23-5b08-4f5b-b890-75f7efdc2147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:41.231980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7ba23-5b08-4f5b-b890-75f7efdc2147 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:41.232330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7ba23-5b08-4f5b-b890-75f7efdc2147 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:41.232673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7ba23-5b08-4f5b-b890-75f7efdc2147 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:41.246097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7ba23-5b08-4f5b-b890-75f7efdc2147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:41.254432 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-dea7ba23-5b08-4f5b-b890-75f7efdc2147 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:38:41.256333 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 48/83] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:38:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:41.257627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7ba23-5b08-4f5b-b890-75f7efdc2147 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:41.326759 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b8731-a690-4086-80d2-a9d3d6071501 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:41.371104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451758-1c8d-458f-b5d4-cfcc40ce809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:41.372121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451758-1c8d-458f-b5d4-cfcc40ce809f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:41.372581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451758-1c8d-458f-b5d4-cfcc40ce809f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:41.372999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451758-1c8d-458f-b5d4-cfcc40ce809f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:41.374375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7451758-1c8d-458f-b5d4-cfcc40ce809f None admin] RBAC: Adding query filter params (role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user.id=0c7219524d1b4afd8d1aea23de18a164) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:41.374881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7451758-1c8d-458f-b5d4-cfcc40ce809f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:41.377442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7451758-1c8d-458f-b5d4-cfcc40ce809f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:41.382268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7ba23-5b08-4f5b-b890-75f7efdc2147 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:41.387119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 36/84] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:38:41 2022] GET /identity/v3/role_assignments?user.id=0c7219524d1b4afd8d1aea23de18a164&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:41.388209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451758-1c8d-458f-b5d4-cfcc40ce809f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:41.425726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28a7d3-add1-4780-b7c7-f05f1980bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:41.426517 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28a7d3-add1-4780-b7c7-f05f1980bf05 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:41.426806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28a7d3-add1-4780-b7c7-f05f1980bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:41.427096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28a7d3-add1-4780-b7c7-f05f1980bf05 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:41.427898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28a7d3-add1-4780-b7c7-f05f1980bf05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:41.429421 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28a7d3-add1-4780-b7c7-f05f1980bf05 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:41.459621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 49/85] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:38:41 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:38:41.467216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28a7d3-add1-4780-b7c7-f05f1980bf05 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:41.553614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451758-1c8d-458f-b5d4-cfcc40ce809f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:41.610331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d0471-3811-49a3-af9c-094e72c95be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:41.611347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d0471-3811-49a3-af9c-094e72c95be1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:41.611936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d0471-3811-49a3-af9c-094e72c95be1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:41.612465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d0471-3811-49a3-af9c-094e72c95be1 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:41.613957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d0471-3811-49a3-af9c-094e72c95be1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:41.614653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d0471-3811-49a3-af9c-094e72c95be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:41.617481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d0471-3811-49a3-af9c-094e72c95be1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:41.633464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 37/86] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:41.634991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d0471-3811-49a3-af9c-094e72c95be1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:41.656874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28a7d3-add1-4780-b7c7-f05f1980bf05 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:41.698260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005447b-08a2-4157-9626-00690aa459da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:41.699508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005447b-08a2-4157-9626-00690aa459da None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:41.699979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005447b-08a2-4157-9626-00690aa459da None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:41.700256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005447b-08a2-4157-9626-00690aa459da None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:41.702437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005447b-08a2-4157-9626-00690aa459da None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:41.704043 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005447b-08a2-4157-9626-00690aa459da None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:41.706019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 50/87] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:41 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:41.709367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005447b-08a2-4157-9626-00690aa459da None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:41.814170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d0471-3811-49a3-af9c-094e72c95be1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:41.864037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005447b-08a2-4157-9626-00690aa459da None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:41.883816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bccf15-133c-4afb-a792-338d1156daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:41.885536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bccf15-133c-4afb-a792-338d1156daac None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:41.886433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bccf15-133c-4afb-a792-338d1156daac None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:41.887168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bccf15-133c-4afb-a792-338d1156daac None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:41.888800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bccf15-133c-4afb-a792-338d1156daac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:41.889643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bccf15-133c-4afb-a792-338d1156daac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:41.892478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bccf15-133c-4afb-a792-338d1156daac None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:41.904960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39cac-fcf0-4b7a-a8ba-ec2208b65ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:41.905896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39cac-fcf0-4b7a-a8ba-ec2208b65ac5 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:41.906210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39cac-fcf0-4b7a-a8ba-ec2208b65ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:41.906506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39cac-fcf0-4b7a-a8ba-ec2208b65ac5 None admin] PATH_INFO: `/v3/users/0c7219524d1b4afd8d1aea23de18a164` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:41.907850 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba39cac-fcf0-4b7a-a8ba-ec2208b65ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=0c7219524d1b4afd8d1aea23de18a164)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:41.909406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba39cac-fcf0-4b7a-a8ba-ec2208b65ac5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:41.911522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 51/88] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:41 2022] GET /identity/v3/users/0c7219524d1b4afd8d1aea23de18a164 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:41.912210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39cac-fcf0-4b7a-a8ba-ec2208b65ac5 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:41.915106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 38/89] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:38:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:41.929179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bccf15-133c-4afb-a792-338d1156daac None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:42.036636 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39cac-fcf0-4b7a-a8ba-ec2208b65ac5 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:42.092312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2791-4251-4faf-8d05-cc61bc6a2c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:42.093053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2791-4251-4faf-8d05-cc61bc6a2c71 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:42.093348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2791-4251-4faf-8d05-cc61bc6a2c71 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:42.093633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2791-4251-4faf-8d05-cc61bc6a2c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:42.094537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2791-4251-4faf-8d05-cc61bc6a2c71 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user.id=686bfe5266224121af654efbb4f624b9) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:42.094874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2791-4251-4faf-8d05-cc61bc6a2c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:42.096391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2791-4251-4faf-8d05-cc61bc6a2c71 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:42.110090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 52/90] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:38:41 2022] GET /identity/v3/role_assignments?user.id=686bfe5266224121af654efbb4f624b9&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:42.111208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2791-4251-4faf-8d05-cc61bc6a2c71 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:42.117726 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bccf15-133c-4afb-a792-338d1156daac None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:42.193519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac124b6-ec23-4a9f-962e-1feed0593146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:42.194640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac124b6-ec23-4a9f-962e-1feed0593146 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:42.195144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac124b6-ec23-4a9f-962e-1feed0593146 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:42.195648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac124b6-ec23-4a9f-962e-1feed0593146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:42.323898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2791-4251-4faf-8d05-cc61bc6a2c71 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:42.397430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac124b6-ec23-4a9f-962e-1feed0593146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:42.400364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac124b6-ec23-4a9f-962e-1feed0593146 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:42.409363 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83756eed-1b69-4348-a101-574a8097b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:42.411001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83756eed-1b69-4348-a101-574a8097b1bd None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:42.413028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83756eed-1b69-4348-a101-574a8097b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:42.413502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83756eed-1b69-4348-a101-574a8097b1bd None admin] PATH_INFO: `/v3/users/0c7219524d1b4afd8d1aea23de18a164` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:42.417029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83756eed-1b69-4348-a101-574a8097b1bd None admin] RBAC: Authorizing `identity:get_user(user_id=0c7219524d1b4afd8d1aea23de18a164)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:42.421068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83756eed-1b69-4348-a101-574a8097b1bd None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:42.425240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 53/91] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:42 2022] GET /identity/v3/users/0c7219524d1b4afd8d1aea23de18a164 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:42.430226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83756eed-1b69-4348-a101-574a8097b1bd None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:42.612058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 39/92] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:38:42.635598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac124b6-ec23-4a9f-962e-1feed0593146 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:42.749571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83756eed-1b69-4348-a101-574a8097b1bd None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:42.833786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac124b6-ec23-4a9f-962e-1feed0593146 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:42.885393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dfbe7-8801-4754-ae78-6f814ffa1d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:42.886934 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dfbe7-8801-4754-ae78-6f814ffa1d24 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:42.887669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dfbe7-8801-4754-ae78-6f814ffa1d24 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:42.888524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dfbe7-8801-4754-ae78-6f814ffa1d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:42.923390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6243-3ed4-496a-b006-6722b218271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:42.925410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6243-3ed4-496a-b006-6722b218271c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:42.930472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6243-3ed4-496a-b006-6722b218271c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:42.931572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6243-3ed4-496a-b006-6722b218271c None admin] PATH_INFO: `/v3/projects/b0c2be7a4e4d45a0a6b56d87c4aa7ba4` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:42.934638 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6243-3ed4-496a-b006-6722b218271c None admin] RBAC: Authorizing `identity:get_project(project_id=b0c2be7a4e4d45a0a6b56d87c4aa7ba4)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:42.941639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6243-3ed4-496a-b006-6722b218271c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:42.949970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 40/93] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:42 2022] GET /identity/v3/projects/b0c2be7a4e4d45a0a6b56d87c4aa7ba4 => generated 312 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:42.958641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6243-3ed4-496a-b006-6722b218271c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:43.105334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dfbe7-8801-4754-ae78-6f814ffa1d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:43.108122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dfbe7-8801-4754-ae78-6f814ffa1d24 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:43.144672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6243-3ed4-496a-b006-6722b218271c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:43.195432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49063fe-3760-4187-a537-82ae502717e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:43.196498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49063fe-3760-4187-a537-82ae502717e1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:43.197009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49063fe-3760-4187-a537-82ae502717e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:43.197616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49063fe-3760-4187-a537-82ae502717e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:43.198724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49063fe-3760-4187-a537-82ae502717e1 None admin] RBAC: Adding query filter params (role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=b0c2be7a4e4d45a0a6b56d87c4aa7ba4, user.id=0c7219524d1b4afd8d1aea23de18a164) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:43.199269 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49063fe-3760-4187-a537-82ae502717e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:43.200962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49063fe-3760-4187-a537-82ae502717e1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:43.212432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 41/94] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:38:42 2022] GET /identity/v3/role_assignments?user.id=0c7219524d1b4afd8d1aea23de18a164&scope.project.id=b0c2be7a4e4d45a0a6b56d87c4aa7ba4&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:43.323673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 54/95] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 894 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:38:43.332843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49063fe-3760-4187-a537-82ae502717e1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:43.551990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49063fe-3760-4187-a537-82ae502717e1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:43.623811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889a917-5ae3-42c6-b56a-a8c0cd342ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:43.625399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a917-5ae3-42c6-b56a-a8c0cd342ed2 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:43.625900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a917-5ae3-42c6-b56a-a8c0cd342ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:43.626445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a917-5ae3-42c6-b56a-a8c0cd342ed2 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:43.628920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889a917-5ae3-42c6-b56a-a8c0cd342ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:43.631745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889a917-5ae3-42c6-b56a-a8c0cd342ed2 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:43.636407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 42/96] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:43 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:43.643343 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dfbe7-8801-4754-ae78-6f814ffa1d24 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:43.844427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dfbe7-8801-4754-ae78-6f814ffa1d24 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:43.918341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b3a2-7f96-4e04-aa8d-d7188cd7b9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:43.919507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b3a2-7f96-4e04-aa8d-d7188cd7b9e3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:43.919981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b3a2-7f96-4e04-aa8d-d7188cd7b9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:43.920548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b3a2-7f96-4e04-aa8d-d7188cd7b9e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:43.922566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5b3a2-7f96-4e04-aa8d-d7188cd7b9e3 None admin] RBAC: Adding query filter params (role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user.id=0c7219524d1b4afd8d1aea23de18a164) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:43.923120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5b3a2-7f96-4e04-aa8d-d7188cd7b9e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:43.925824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5b3a2-7f96-4e04-aa8d-d7188cd7b9e3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:43.946854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 55/97] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:38:43 2022] GET /identity/v3/role_assignments?user.id=0c7219524d1b4afd8d1aea23de18a164&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:44.926900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49602c81-411e-41c4-8fa5-c6b662b7c502 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:44.927577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49602c81-411e-41c4-8fa5-c6b662b7c502 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:44.927912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49602c81-411e-41c4-8fa5-c6b662b7c502 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:44.931661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 43/98] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:44.940616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdd20c-b844-4985-9700-5b17f2d6d0be None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:44.941375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdd20c-b844-4985-9700-5b17f2d6d0be None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:44.941530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdd20c-b844-4985-9700-5b17f2d6d0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:44.975283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-49cdd20c-b844-4985-9700-5b17f2d6d0be None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:44.977299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-49cdd20c-b844-4985-9700-5b17f2d6d0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:45.109788 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 56/99] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:45.164981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49602c81-411e-41c4-8fa5-c6b662b7c502 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:45.368065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49602c81-411e-41c4-8fa5-c6b662b7c502 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:45.439629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410e90-5f8a-48fb-ac9d-f71b1bbb3803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:45.440982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410e90-5f8a-48fb-ac9d-f71b1bbb3803 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:45.441467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410e90-5f8a-48fb-ac9d-f71b1bbb3803 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:45.441968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410e90-5f8a-48fb-ac9d-f71b1bbb3803 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:45.475642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4410e90-5f8a-48fb-ac9d-f71b1bbb3803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:45.489791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b4410e90-5f8a-48fb-ac9d-f71b1bbb3803 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:38:45.492483 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 44/100] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:45.498857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdd20c-b844-4985-9700-5b17f2d6d0be None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:45.662085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdd20c-b844-4985-9700-5b17f2d6d0be None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:45.709226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4f929-6262-48bb-9849-c10f29a792ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:45.710332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4f929-6262-48bb-9849-c10f29a792ff None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:45.710832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4f929-6262-48bb-9849-c10f29a792ff None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:45.711308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4f929-6262-48bb-9849-c10f29a792ff None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:45.712275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4f929-6262-48bb-9849-c10f29a792ff None admin] RBAC: Adding query filter params (name=member) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:45.712816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4f929-6262-48bb-9849-c10f29a792ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:45.714704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4f929-6262-48bb-9849-c10f29a792ff None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:45.736291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 57/101] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:38:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:45.743133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410e90-5f8a-48fb-ac9d-f71b1bbb3803 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:46.011132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410e90-5f8a-48fb-ac9d-f71b1bbb3803 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:46.099682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246e25a-2a0c-42c8-b2c3-add4c183c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:46.101248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246e25a-2a0c-42c8-b2c3-add4c183c5ed None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:46.101745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246e25a-2a0c-42c8-b2c3-add4c183c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:46.102278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246e25a-2a0c-42c8-b2c3-add4c183c5ed None admin] PATH_INFO: `/v3/users/0c7219524d1b4afd8d1aea23de18a164` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:46.107562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246e25a-2a0c-42c8-b2c3-add4c183c5ed None admin] RBAC: Authorizing `identity:get_user(user_id=0c7219524d1b4afd8d1aea23de18a164)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:46.110608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246e25a-2a0c-42c8-b2c3-add4c183c5ed None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:46.114568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 45/102] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:45 2022] GET /identity/v3/users/0c7219524d1b4afd8d1aea23de18a164 => generated 275 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:46.121747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4f929-6262-48bb-9849-c10f29a792ff None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:46.330777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4f929-6262-48bb-9849-c10f29a792ff None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:46.408439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a27a10-0fb2-41f3-bf57-5ea64e070e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:46.410238 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a27a10-0fb2-41f3-bf57-5ea64e070e32 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:46.410791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a27a10-0fb2-41f3-bf57-5ea64e070e32 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:46.411317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a27a10-0fb2-41f3-bf57-5ea64e070e32 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:46.414182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a27a10-0fb2-41f3-bf57-5ea64e070e32 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:46.421176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a27a10-0fb2-41f3-bf57-5ea64e070e32 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:46.424273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 58/103] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:46 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:46.430933 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246e25a-2a0c-42c8-b2c3-add4c183c5ed None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:46.570470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246e25a-2a0c-42c8-b2c3-add4c183c5ed None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:46.623516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea85450-7925-4800-9479-22b4c6c574c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:46.624783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea85450-7925-4800-9479-22b4c6c574c7 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:46.625289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea85450-7925-4800-9479-22b4c6c574c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:46.625763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea85450-7925-4800-9479-22b4c6c574c7 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/users/0c7219524d1b4afd8d1aea23de18a164/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:46.631544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea85450-7925-4800-9479-22b4c6c574c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user_id=0c7219524d1b4afd8d1aea23de18a164, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:46.633382 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea85450-7925-4800-9479-22b4c6c574c7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:46.656102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 46/104] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:38:46 2022] PUT /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/users/0c7219524d1b4afd8d1aea23de18a164/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:38:46.911457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abae1f-251b-42d0-9ebb-f42c2d62ce52 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:46.912102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abae1f-251b-42d0-9ebb-f42c2d62ce52 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:46.912595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abae1f-251b-42d0-9ebb-f42c2d62ce52 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:46.915073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 59/105] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:46.923329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174cd2-96c4-4048-bdd5-07b092c18534 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:46.923631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174cd2-96c4-4048-bdd5-07b092c18534 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:46.923896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174cd2-96c4-4048-bdd5-07b092c18534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:46.942886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5debfea-35f0-434d-af7e-14fddcdf198d None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:46.943518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5debfea-35f0-434d-af7e-14fddcdf198d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:46.944029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5debfea-35f0-434d-af7e-14fddcdf198d None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:46.946655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 60/106] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:46.948395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf3b43-0882-4d19-b684-469b25c1d193 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:46.948927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf3b43-0882-4d19-b684-469b25c1d193 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:46.949407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf3b43-0882-4d19-b684-469b25c1d193 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:46.952528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-0b174cd2-96c4-4048-bdd5-07b092c18534 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:46.953824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0b174cd2-96c4-4048-bdd5-07b092c18534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:46.955221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 61/107] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:46.959698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62d80-1551-4d7f-809d-161ccefb8b5d None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:46.960344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62d80-1551-4d7f-809d-161ccefb8b5d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:46.960815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62d80-1551-4d7f-809d-161ccefb8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:46.994409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-7da62d80-1551-4d7f-809d-161ccefb8b5d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:46.995792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7da62d80-1551-4d7f-809d-161ccefb8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:47.073499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 47/108] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:47.080981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f845f0-578a-4489-a67f-9a7b5474513c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:47.081627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f845f0-578a-4489-a67f-9a7b5474513c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:47.082300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f845f0-578a-4489-a67f-9a7b5474513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:47.117566 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-19f845f0-578a-4489-a67f-9a7b5474513c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:47.120681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-19f845f0-578a-4489-a67f-9a7b5474513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:47.154513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 62/109] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:47.155994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da62d80-1551-4d7f-809d-161ccefb8b5d None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:47.217801 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 48/110] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:47.218953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f845f0-578a-4489-a67f-9a7b5474513c None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:47.327746 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f845f0-578a-4489-a67f-9a7b5474513c None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:47.368958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cce18b-1753-4eb5-acb7-7b035990f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:47.372395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cce18b-1753-4eb5-acb7-7b035990f762 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:47.373036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cce18b-1753-4eb5-acb7-7b035990f762 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:47.373668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cce18b-1753-4eb5-acb7-7b035990f762 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:47.377524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cce18b-1753-4eb5-acb7-7b035990f762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:47.379390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cce18b-1753-4eb5-acb7-7b035990f762 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:47.382882 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 49/111] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:47.384078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cce18b-1753-4eb5-acb7-7b035990f762 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:47.388752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da62d80-1551-4d7f-809d-161ccefb8b5d None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:47.449849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed17c-34b8-4aa7-ad2d-56215165a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:47.450961 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed17c-34b8-4aa7-ad2d-56215165a900 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:47.451401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed17c-34b8-4aa7-ad2d-56215165a900 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:47.451846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed17c-34b8-4aa7-ad2d-56215165a900 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:47.475023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ed17c-34b8-4aa7-ad2d-56215165a900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:47.491202 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-7c8ed17c-34b8-4aa7-ad2d-56215165a900 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 22 19:38:47.492676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 63/112] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:47.493346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed17c-34b8-4aa7-ad2d-56215165a900 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:47.503586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cce18b-1753-4eb5-acb7-7b035990f762 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:47.545440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64940de-14de-421a-a9a1-9fd2a1bae1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:47.546425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64940de-14de-421a-a9a1-9fd2a1bae1c9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:47.546717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64940de-14de-421a-a9a1-9fd2a1bae1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:47.546999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64940de-14de-421a-a9a1-9fd2a1bae1c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:47.571117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64940de-14de-421a-a9a1-9fd2a1bae1c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:47.578507 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-e64940de-14de-421a-a9a1-9fd2a1bae1c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:38:47.579881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 50/113] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:38:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:47.580744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64940de-14de-421a-a9a1-9fd2a1bae1c9 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:47.792313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed17c-34b8-4aa7-ad2d-56215165a900 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:47.854528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9263a1a-a47e-4a58-bf43-6ddce00e819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:47.855972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9263a1a-a47e-4a58-bf43-6ddce00e819c None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:47.856631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9263a1a-a47e-4a58-bf43-6ddce00e819c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:47.857394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9263a1a-a47e-4a58-bf43-6ddce00e819c None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:47.859023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9263a1a-a47e-4a58-bf43-6ddce00e819c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:47.862064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9263a1a-a47e-4a58-bf43-6ddce00e819c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:47.876214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64940de-14de-421a-a9a1-9fd2a1bae1c9 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:47.909230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 64/114] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:38:47 2022] POST /identity/v3/projects => generated 302 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:38:47.915925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9263a1a-a47e-4a58-bf43-6ddce00e819c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:47.931407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507cb77-ca92-47d9-a7ca-fa5dd8538213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:47.932143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507cb77-ca92-47d9-a7ca-fa5dd8538213 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:47.932431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507cb77-ca92-47d9-a7ca-fa5dd8538213 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:47.932713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507cb77-ca92-47d9-a7ca-fa5dd8538213 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:47.933490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507cb77-ca92-47d9-a7ca-fa5dd8538213 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:47.933802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507cb77-ca92-47d9-a7ca-fa5dd8538213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:47.935361 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507cb77-ca92-47d9-a7ca-fa5dd8538213 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:47.948463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 51/115] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:38:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:47.950035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21abc7-1049-43f5-ac0e-a353a2c3f8ba None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:47.950336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21abc7-1049-43f5-ac0e-a353a2c3f8ba None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:47.961517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21abc7-1049-43f5-ac0e-a353a2c3f8ba None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:47.967345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 52/116] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:47 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:47.968652 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21abc7-1049-43f5-ac0e-a353a2c3f8ba None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:48.154278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21abc7-1049-43f5-ac0e-a353a2c3f8ba None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:48.201023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9263a1a-a47e-4a58-bf43-6ddce00e819c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:48.220652 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f47b0c-2da4-4d80-bf23-2085324cccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:48.221832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f47b0c-2da4-4d80-bf23-2085324cccf5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:48.222299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f47b0c-2da4-4d80-bf23-2085324cccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:48.222793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f47b0c-2da4-4d80-bf23-2085324cccf5 None admin] PATH_INFO: `/v3/users/0291274e337040b4bdbc8d05c5e326c8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:48.240014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f47b0c-2da4-4d80-bf23-2085324cccf5 None admin] RBAC: Authorizing `identity:get_user(user_id=0291274e337040b4bdbc8d05c5e326c8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:48.242076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f47b0c-2da4-4d80-bf23-2085324cccf5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:48.244365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 53/117] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:47 2022] GET /identity/v3/users/0291274e337040b4bdbc8d05c5e326c8 => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:48.246072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9599a-4cc4-4f22-9a3a-4481ba03a695 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:48.246582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9599a-4cc4-4f22-9a3a-4481ba03a695 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:48.247058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9599a-4cc4-4f22-9a3a-4481ba03a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:48.267274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-04b9599a-4cc4-4f22-9a3a-4481ba03a695 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:48.268918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-04b9599a-4cc4-4f22-9a3a-4481ba03a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:48.274044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db70e5a-0486-43c9-ba1f-d67b6ff13816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:48.274996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70e5a-0486-43c9-ba1f-d67b6ff13816 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:48.275560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70e5a-0486-43c9-ba1f-d67b6ff13816 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:48.276226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70e5a-0486-43c9-ba1f-d67b6ff13816 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:48.277205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db70e5a-0486-43c9-ba1f-d67b6ff13816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:48.277520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db70e5a-0486-43c9-ba1f-d67b6ff13816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:48.279029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db70e5a-0486-43c9-ba1f-d67b6ff13816 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:48.289004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 65/118] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:48.290156 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec090d-ce49-4ed7-b911-cf70057545d8 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:48.290659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec090d-ce49-4ed7-b911-cf70057545d8 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:48.291112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec090d-ce49-4ed7-b911-cf70057545d8 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:48.293545 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 66/119] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:48.294627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec090d-ce49-4ed7-b911-cf70057545d8 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:48.381003 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 54/120] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:48.382590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9599a-4cc4-4f22-9a3a-4481ba03a695 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:48.431771 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec090d-ce49-4ed7-b911-cf70057545d8 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:48.475681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c97b1-4877-4f95-95fa-f363bb1847d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:48.476629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c97b1-4877-4f95-95fa-f363bb1847d6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:48.477074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c97b1-4877-4f95-95fa-f363bb1847d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:48.477485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c97b1-4877-4f95-95fa-f363bb1847d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:48.553715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c97b1-4877-4f95-95fa-f363bb1847d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:48.555495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c97b1-4877-4f95-95fa-f363bb1847d6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:48.567195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9599a-4cc4-4f22-9a3a-4481ba03a695 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:48.629462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa1364-5f5e-479c-971a-a6885a21adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:48.631486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa1364-5f5e-479c-971a-a6885a21adee None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:48.631486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa1364-5f5e-479c-971a-a6885a21adee None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:48.631682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa1364-5f5e-479c-971a-a6885a21adee None admin] PATH_INFO: `/v3/users/686bfe5266224121af654efbb4f624b9` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:48.633510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa1364-5f5e-479c-971a-a6885a21adee None admin] RBAC: Authorizing `identity:get_user(user_id=686bfe5266224121af654efbb4f624b9)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:48.635879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa1364-5f5e-479c-971a-a6885a21adee None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:48.638388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 55/121] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:48 2022] GET /identity/v3/users/686bfe5266224121af654efbb4f624b9 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:48.640431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e9dd1-ac4d-4582-8646-6446812c6392 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:48.640930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e9dd1-ac4d-4582-8646-6446812c6392 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:48.641418 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e9dd1-ac4d-4582-8646-6446812c6392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:48.665059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 67/122] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:38:48.666228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c97b1-4877-4f95-95fa-f363bb1847d6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:48.671405 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-898e9dd1-ac4d-4582-8646-6446812c6392 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:48.673446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-898e9dd1-ac4d-4582-8646-6446812c6392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:48.777156 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c97b1-4877-4f95-95fa-f363bb1847d6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:48.798696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 56/123] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:48.800380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e9dd1-ac4d-4582-8646-6446812c6392 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:48.813526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9665f9-56a4-4665-ab37-8900b8f59e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:48.814687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9665f9-56a4-4665-ab37-8900b8f59e0c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:48.815138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9665f9-56a4-4665-ab37-8900b8f59e0c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:48.815607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9665f9-56a4-4665-ab37-8900b8f59e0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:48.827483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9665f9-56a4-4665-ab37-8900b8f59e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:48.834785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-7b9665f9-56a4-4665-ab37-8900b8f59e0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:38:48.836292 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 68/124] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:48.837274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9665f9-56a4-4665-ab37-8900b8f59e0c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:48.943162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9665f9-56a4-4665-ab37-8900b8f59e0c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:48.979318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e9dd1-ac4d-4582-8646-6446812c6392 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:48.983443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e43cf-9e87-47be-8dfa-efb646bdefea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:48.984688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e43cf-9e87-47be-8dfa-efb646bdefea None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:48.985191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e43cf-9e87-47be-8dfa-efb646bdefea None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:48.985657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e43cf-9e87-47be-8dfa-efb646bdefea None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:48.987289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e43cf-9e87-47be-8dfa-efb646bdefea None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:48.989021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e43cf-9e87-47be-8dfa-efb646bdefea None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:48.991057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 69/125] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:48 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:48.992067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e43cf-9e87-47be-8dfa-efb646bdefea None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:49.044029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6744-370e-42ea-8c15-92c14929d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:49.045458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6744-370e-42ea-8c15-92c14929d968 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:49.046172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6744-370e-42ea-8c15-92c14929d968 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:49.047069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6744-370e-42ea-8c15-92c14929d968 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:49.049417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e6744-370e-42ea-8c15-92c14929d968 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:49.053239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e6744-370e-42ea-8c15-92c14929d968 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:49.058125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 57/126] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:48 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:49.060379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6744-370e-42ea-8c15-92c14929d968 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:49.151445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e43cf-9e87-47be-8dfa-efb646bdefea None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:49.189079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147ad33-96e4-4b4e-89c6-fcedc47511e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:49.190334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ad33-96e4-4b4e-89c6-fcedc47511e7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:49.190827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ad33-96e4-4b4e-89c6-fcedc47511e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:49.191302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ad33-96e4-4b4e-89c6-fcedc47511e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:49.203276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147ad33-96e4-4b4e-89c6-fcedc47511e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:49.204029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6744-370e-42ea-8c15-92c14929d968 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:49.211597 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-e147ad33-96e4-4b4e-89c6-fcedc47511e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:38:49.213350 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 70/127] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:38:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:49.214844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147ad33-96e4-4b4e-89c6-fcedc47511e7 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:49.284437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013fbe0-c4bb-43dc-9bd4-c70dde11602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:49.285660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013fbe0-c4bb-43dc-9bd4-c70dde11602d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:49.286181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013fbe0-c4bb-43dc-9bd4-c70dde11602d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:49.286670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013fbe0-c4bb-43dc-9bd4-c70dde11602d None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:49.288358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013fbe0-c4bb-43dc-9bd4-c70dde11602d None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:49.288925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013fbe0-c4bb-43dc-9bd4-c70dde11602d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:49.291544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013fbe0-c4bb-43dc-9bd4-c70dde11602d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:49.305477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 58/128] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:38:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:49.306755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013fbe0-c4bb-43dc-9bd4-c70dde11602d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:49.363193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147ad33-96e4-4b4e-89c6-fcedc47511e7 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:49.425745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89ac6-c126-4bfa-8da2-ffb35d026a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:49.428184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89ac6-c126-4bfa-8da2-ffb35d026a61 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:49.429034 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89ac6-c126-4bfa-8da2-ffb35d026a61 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:49.429959 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89ac6-c126-4bfa-8da2-ffb35d026a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:49.432706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89ac6-c126-4bfa-8da2-ffb35d026a61 None admin] RBAC: Adding query filter params (role.id=8970adb53a594bf68973ee9679c03bcd, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user.id=0291274e337040b4bdbc8d05c5e326c8) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:49.433493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89ac6-c126-4bfa-8da2-ffb35d026a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:49.438303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89ac6-c126-4bfa-8da2-ffb35d026a61 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:49.441107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013fbe0-c4bb-43dc-9bd4-c70dde11602d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:49.453254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 71/129] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:38:49 2022] GET /identity/v3/role_assignments?user.id=0291274e337040b4bdbc8d05c5e326c8&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=8970adb53a594bf68973ee9679c03bcd => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:49.456195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89ac6-c126-4bfa-8da2-ffb35d026a61 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:49.484023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f5422-6b13-42ad-90a1-dc02e156dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:49.485125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f5422-6b13-42ad-90a1-dc02e156dbd3 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:49.485529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f5422-6b13-42ad-90a1-dc02e156dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:49.486358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f5422-6b13-42ad-90a1-dc02e156dbd3 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/users/686bfe5266224121af654efbb4f624b9/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:49.488134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f5422-6b13-42ad-90a1-dc02e156dbd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user_id=686bfe5266224121af654efbb4f624b9, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:49.489730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f5422-6b13-42ad-90a1-dc02e156dbd3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:49.508578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 59/130] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:38:49 2022] PUT /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/users/686bfe5266224121af654efbb4f624b9/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:38:49.509921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f5422-6b13-42ad-90a1-dc02e156dbd3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:49.644716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89ac6-c126-4bfa-8da2-ffb35d026a61 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:49.690457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c4c48-78ae-4af9-adab-ac0763c5d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:49.691153 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c4c48-78ae-4af9-adab-ac0763c5d906 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:49.691435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c4c48-78ae-4af9-adab-ac0763c5d906 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:49.691709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c4c48-78ae-4af9-adab-ac0763c5d906 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:49.692481 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c4c48-78ae-4af9-adab-ac0763c5d906 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:49.692787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c4c48-78ae-4af9-adab-ac0763c5d906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:49.694265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c4c48-78ae-4af9-adab-ac0763c5d906 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:49.714042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f5422-6b13-42ad-90a1-dc02e156dbd3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:49.717842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 72/131] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:38:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:49.727010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c4c48-78ae-4af9-adab-ac0763c5d906 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:49.765797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08269acb-5eb0-4a0f-9c09-7db6b905de67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:49.769301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08269acb-5eb0-4a0f-9c09-7db6b905de67 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:49.769692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08269acb-5eb0-4a0f-9c09-7db6b905de67 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:49.770042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08269acb-5eb0-4a0f-9c09-7db6b905de67 None admin] PATH_INFO: `/v3/users/0c7219524d1b4afd8d1aea23de18a164` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:49.781001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08269acb-5eb0-4a0f-9c09-7db6b905de67 None admin] RBAC: Authorizing `identity:get_user(user_id=0c7219524d1b4afd8d1aea23de18a164)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:49.786736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08269acb-5eb0-4a0f-9c09-7db6b905de67 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:49.790670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 60/132] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:49 2022] GET /identity/v3/users/0c7219524d1b4afd8d1aea23de18a164 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:49.798178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08269acb-5eb0-4a0f-9c09-7db6b905de67 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:49.931221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c4c48-78ae-4af9-adab-ac0763c5d906 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:49.998044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0a10a-e41a-4ffb-b91a-151988797395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:49.998965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0a10a-e41a-4ffb-b91a-151988797395 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:49.999290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0a10a-e41a-4ffb-b91a-151988797395 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:49.999570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0a10a-e41a-4ffb-b91a-151988797395 None admin] PATH_INFO: `/v3/users/0c7219524d1b4afd8d1aea23de18a164` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:50.000865 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0a10a-e41a-4ffb-b91a-151988797395 None admin] RBAC: Authorizing `identity:get_user(user_id=0c7219524d1b4afd8d1aea23de18a164)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:50.002395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0a10a-e41a-4ffb-b91a-151988797395 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:50.004323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 73/133] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:49 2022] GET /identity/v3/users/0c7219524d1b4afd8d1aea23de18a164 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:50.012960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0a10a-e41a-4ffb-b91a-151988797395 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:50.065028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08269acb-5eb0-4a0f-9c09-7db6b905de67 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:50.136774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527beb1d-9d74-4d2f-85c2-72d1ef878ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:50.138370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527beb1d-9d74-4d2f-85c2-72d1ef878ab1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:50.138858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527beb1d-9d74-4d2f-85c2-72d1ef878ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:50.139378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527beb1d-9d74-4d2f-85c2-72d1ef878ab1 None admin] PATH_INFO: `/v3/projects/b0c2be7a4e4d45a0a6b56d87c4aa7ba4` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:50.147393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527beb1d-9d74-4d2f-85c2-72d1ef878ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c2be7a4e4d45a0a6b56d87c4aa7ba4)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:50.152428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527beb1d-9d74-4d2f-85c2-72d1ef878ab1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:50.153843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 61/134] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:49 2022] GET /identity/v3/projects/b0c2be7a4e4d45a0a6b56d87c4aa7ba4 => generated 312 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:50.163031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527beb1d-9d74-4d2f-85c2-72d1ef878ab1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:50.323370 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0a10a-e41a-4ffb-b91a-151988797395 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:50.456948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2097ea-a0bc-4cf8-a64b-53790d9aac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:50.458935 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2097ea-a0bc-4cf8-a64b-53790d9aac83 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:50.459414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2097ea-a0bc-4cf8-a64b-53790d9aac83 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:50.459914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2097ea-a0bc-4cf8-a64b-53790d9aac83 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:50.467621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2097ea-a0bc-4cf8-a64b-53790d9aac83 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:50.476286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2097ea-a0bc-4cf8-a64b-53790d9aac83 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:50.483123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 74/135] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:50 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:50.492010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2097ea-a0bc-4cf8-a64b-53790d9aac83 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:50.517978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527beb1d-9d74-4d2f-85c2-72d1ef878ab1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:50.594964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861389d-962d-486e-909b-86dd0327cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:50.596941 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861389d-962d-486e-909b-86dd0327cd1a None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:50.597709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861389d-962d-486e-909b-86dd0327cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:50.598259 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861389d-962d-486e-909b-86dd0327cd1a None admin] PATH_INFO: `/v3/projects/b0c2be7a4e4d45a0a6b56d87c4aa7ba4/users/0c7219524d1b4afd8d1aea23de18a164/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:50.603738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861389d-962d-486e-909b-86dd0327cd1a None admin] RBAC: Authorizing `identity:create_grant(project_id=b0c2be7a4e4d45a0a6b56d87c4aa7ba4, user_id=0c7219524d1b4afd8d1aea23de18a164, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:50.607934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861389d-962d-486e-909b-86dd0327cd1a None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:50.641301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 62/136] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:38:50 2022] PUT /identity/v3/projects/b0c2be7a4e4d45a0a6b56d87c4aa7ba4/users/0c7219524d1b4afd8d1aea23de18a164/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:38:50.731377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2097ea-a0bc-4cf8-a64b-53790d9aac83 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:50.808403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6e129-fece-4432-804d-eb53be4dda41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:50.810133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6e129-fece-4432-804d-eb53be4dda41 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:50.810625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6e129-fece-4432-804d-eb53be4dda41 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:50.811126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6e129-fece-4432-804d-eb53be4dda41 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/users/0c7219524d1b4afd8d1aea23de18a164/roles/3dae28c0ed754e34b0024bbb40d02fb7` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:50.821575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6e129-fece-4432-804d-eb53be4dda41 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user_id=0c7219524d1b4afd8d1aea23de18a164, role_id=3dae28c0ed754e34b0024bbb40d02fb7)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:50.824813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6e129-fece-4432-804d-eb53be4dda41 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:50.861330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 75/137] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:38:50 2022] PUT /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/users/0c7219524d1b4afd8d1aea23de18a164/roles/3dae28c0ed754e34b0024bbb40d02fb7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:38:51.626757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4f43a-bf88-408b-8f00-c43fb3c3be23 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:51.627513 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4f43a-bf88-408b-8f00-c43fb3c3be23 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:51.628305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4f43a-bf88-408b-8f00-c43fb3c3be23 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:51.632045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 63/138] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:51.638337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe39b89-7ff0-412f-8e28-7d7a551ebcae None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:51.639158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe39b89-7ff0-412f-8e28-7d7a551ebcae None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:51.639158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe39b89-7ff0-412f-8e28-7d7a551ebcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:51.661528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3fe39b89-7ff0-412f-8e28-7d7a551ebcae None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:51.662824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3fe39b89-7ff0-412f-8e28-7d7a551ebcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:51.749159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 76/139] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:51.785629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4f43a-bf88-408b-8f00-c43fb3c3be23 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:51.996197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4f43a-bf88-408b-8f00-c43fb3c3be23 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:52.051637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0078224-002e-4047-a039-f268e865c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:52.052477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078224-002e-4047-a039-f268e865c7db None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:52.052766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078224-002e-4047-a039-f268e865c7db None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:52.053046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078224-002e-4047-a039-f268e865c7db None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:52.073001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0078224-002e-4047-a039-f268e865c7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:52.080263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-d0078224-002e-4047-a039-f268e865c7db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:38:52.081655 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 64/140] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:52.088057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe39b89-7ff0-412f-8e28-7d7a551ebcae None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:52.095647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aa6ed-0a95-48ec-8051-17417ca9ea34 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:52.096057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aa6ed-0a95-48ec-8051-17417ca9ea34 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:52.096192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aa6ed-0a95-48ec-8051-17417ca9ea34 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:52.098456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 65/141] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:52.114766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490e7cb-de81-4350-a06e-f324f9c865df None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:52.115031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490e7cb-de81-4350-a06e-f324f9c865df None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:52.115350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490e7cb-de81-4350-a06e-f324f9c865df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:52.155209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-f490e7cb-de81-4350-a06e-f324f9c865df None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:52.156459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f490e7cb-de81-4350-a06e-f324f9c865df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:52.224713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe39b89-7ff0-412f-8e28-7d7a551ebcae None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:52.295552 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65272bfa-5892-4222-85e0-66c60abe01c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:52.296166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65272bfa-5892-4222-85e0-66c60abe01c8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:52.296448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65272bfa-5892-4222-85e0-66c60abe01c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:52.296722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65272bfa-5892-4222-85e0-66c60abe01c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:52.297489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65272bfa-5892-4222-85e0-66c60abe01c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:52.297800 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65272bfa-5892-4222-85e0-66c60abe01c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:52.299275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65272bfa-5892-4222-85e0-66c60abe01c8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:52.315595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 77/142] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:38:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:52.320018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 66/143] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:52.321875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65272bfa-5892-4222-85e0-66c60abe01c8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:52.397641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490e7cb-de81-4350-a06e-f324f9c865df None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:52.526495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65272bfa-5892-4222-85e0-66c60abe01c8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:52.600112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490e7cb-de81-4350-a06e-f324f9c865df None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:52.624198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a288c8-af93-40b5-ae87-bd978400f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:52.625526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a288c8-af93-40b5-ae87-bd978400f82f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:52.626030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a288c8-af93-40b5-ae87-bd978400f82f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:52.626500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a288c8-af93-40b5-ae87-bd978400f82f None admin] PATH_INFO: `/v3/users/0c7219524d1b4afd8d1aea23de18a164` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:52.630744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a288c8-af93-40b5-ae87-bd978400f82f None admin] RBAC: Authorizing `identity:get_user(user_id=0c7219524d1b4afd8d1aea23de18a164)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:52.632534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a288c8-af93-40b5-ae87-bd978400f82f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:52.635134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 78/144] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:52 2022] GET /identity/v3/users/0c7219524d1b4afd8d1aea23de18a164 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:52.640289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a288c8-af93-40b5-ae87-bd978400f82f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:52.672078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ab60d-55b9-40e9-a2f5-5a7953b0828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:52.674216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ab60d-55b9-40e9-a2f5-5a7953b0828b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:52.676252 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ab60d-55b9-40e9-a2f5-5a7953b0828b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:52.676798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ab60d-55b9-40e9-a2f5-5a7953b0828b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:52.681332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ab60d-55b9-40e9-a2f5-5a7953b0828b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:52.689169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ab60d-55b9-40e9-a2f5-5a7953b0828b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:52.692874 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 67/145] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:52.699963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ab60d-55b9-40e9-a2f5-5a7953b0828b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:52.913993 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ab60d-55b9-40e9-a2f5-5a7953b0828b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:52.972260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a288c8-af93-40b5-ae87-bd978400f82f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:52.992145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78babad7-7605-4ab7-a621-fdc3922a3a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:52.993338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78babad7-7605-4ab7-a621-fdc3922a3a4f None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:52.993824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78babad7-7605-4ab7-a621-fdc3922a3a4f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:52.994447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78babad7-7605-4ab7-a621-fdc3922a3a4f None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:52.995727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78babad7-7605-4ab7-a621-fdc3922a3a4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:52.998413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78babad7-7605-4ab7-a621-fdc3922a3a4f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:53.067047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 68/146] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:38:52 2022] POST /identity/v3/users => generated 283 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:38:53.070020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b57c1-480f-4018-8248-57c243b8940a None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:53.070514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b57c1-480f-4018-8248-57c243b8940a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:53.070993 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b57c1-480f-4018-8248-57c243b8940a None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:53.075424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 69/147] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:53.082687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa636-8d74-45c6-914b-8104114d7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:53.083493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa636-8d74-45c6-914b-8104114d7e05 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:53.083884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa636-8d74-45c6-914b-8104114d7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:53.084270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa636-8d74-45c6-914b-8104114d7e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:53.085152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfba36-3ce3-40a9-9d9d-78f0b33dfcb7 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:53.085970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfba36-3ce3-40a9-9d9d-78f0b33dfcb7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:53.086621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfba36-3ce3-40a9-9d9d-78f0b33dfcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:53.120471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-dccfba36-3ce3-40a9-9d9d-78f0b33dfcb7 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:53.123524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-dccfba36-3ce3-40a9-9d9d-78f0b33dfcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:53.253185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aa636-8d74-45c6-914b-8104114d7e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:53.254627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aa636-8d74-45c6-914b-8104114d7e05 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:53.287877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 70/148] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:53.342115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfba36-3ce3-40a9-9d9d-78f0b33dfcb7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:53.444629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 79/149] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:38:53.450615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa636-8d74-45c6-914b-8104114d7e05 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:53.522094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfba36-3ce3-40a9-9d9d-78f0b33dfcb7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:53.585220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0a5d-7485-4b23-a86c-90d5789794c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:53.586600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0a5d-7485-4b23-a86c-90d5789794c0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:53.587100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0a5d-7485-4b23-a86c-90d5789794c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:53.587591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0a5d-7485-4b23-a86c-90d5789794c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:53.601928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd0a5d-7485-4b23-a86c-90d5789794c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:53.610965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-86cd0a5d-7485-4b23-a86c-90d5789794c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:38:53.612716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 71/150] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:38:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:38:53.620213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0a5d-7485-4b23-a86c-90d5789794c0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:53.663905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa636-8d74-45c6-914b-8104114d7e05 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:53.707158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357022bf-6f58-4cda-a860-5020a364713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:53.708062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357022bf-6f58-4cda-a860-5020a364713d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:53.708345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357022bf-6f58-4cda-a860-5020a364713d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:53.708625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357022bf-6f58-4cda-a860-5020a364713d None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:53.710875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357022bf-6f58-4cda-a860-5020a364713d None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:53.712410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357022bf-6f58-4cda-a860-5020a364713d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:53.714401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 80/151] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:53 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:53.730769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357022bf-6f58-4cda-a860-5020a364713d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:53.847276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0a5d-7485-4b23-a86c-90d5789794c0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:53.921797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357022bf-6f58-4cda-a860-5020a364713d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:53.946776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467d387-5759-4ea6-b9c0-14ce45e94f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:53.948232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467d387-5759-4ea6-b9c0-14ce45e94f82 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:53.948232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467d387-5759-4ea6-b9c0-14ce45e94f82 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:53.948232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467d387-5759-4ea6-b9c0-14ce45e94f82 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:53.949110 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467d387-5759-4ea6-b9c0-14ce45e94f82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:53.949974 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467d387-5759-4ea6-b9c0-14ce45e94f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:53.951072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467d387-5759-4ea6-b9c0-14ce45e94f82 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:53.969700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 72/152] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:53.980829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb5e28-e4b6-4319-998c-b4f593ed00b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:53.982356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5e28-e4b6-4319-998c-b4f593ed00b8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:53.983106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5e28-e4b6-4319-998c-b4f593ed00b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:53.983767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5e28-e4b6-4319-998c-b4f593ed00b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:53.985591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb5e28-e4b6-4319-998c-b4f593ed00b8 None admin] RBAC: Adding query filter params (role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user.id=0c7219524d1b4afd8d1aea23de18a164) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:53.986365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb5e28-e4b6-4319-998c-b4f593ed00b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:53.989275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb5e28-e4b6-4319-998c-b4f593ed00b8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:53.996237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467d387-5759-4ea6-b9c0-14ce45e94f82 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:54.003574 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 81/153] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:38:53 2022] GET /identity/v3/role_assignments?user.id=0c7219524d1b4afd8d1aea23de18a164&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:54.145683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467d387-5759-4ea6-b9c0-14ce45e94f82 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:54.187744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8037931-b35d-411d-a0be-c6175d6af616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:54.188666 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037931-b35d-411d-a0be-c6175d6af616 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:54.188955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037931-b35d-411d-a0be-c6175d6af616 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:54.189239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037931-b35d-411d-a0be-c6175d6af616 None admin] PATH_INFO: `/v3/users/686bfe5266224121af654efbb4f624b9` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:54.190689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8037931-b35d-411d-a0be-c6175d6af616 None admin] RBAC: Authorizing `identity:get_user(user_id=686bfe5266224121af654efbb4f624b9)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:54.192238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8037931-b35d-411d-a0be-c6175d6af616 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:54.194372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 73/154] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:53 2022] GET /identity/v3/users/686bfe5266224121af654efbb4f624b9 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:54.203627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb5e28-e4b6-4319-998c-b4f593ed00b8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:54.296718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34421ed-6567-4510-87cf-dcba156ad253 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:54.297017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34421ed-6567-4510-87cf-dcba156ad253 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:54.297309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34421ed-6567-4510-87cf-dcba156ad253 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:54.299172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 74/155] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:38:54.310282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d24c67-2835-49c2-9ada-4de090dca80d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:54.310282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d24c67-2835-49c2-9ada-4de090dca80d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:54.310282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d24c67-2835-49c2-9ada-4de090dca80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:54.345676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-43d24c67-2835-49c2-9ada-4de090dca80d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:54.348157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-43d24c67-2835-49c2-9ada-4de090dca80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:54.433134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb5e28-e4b6-4319-998c-b4f593ed00b8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:54.501296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 75/156] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:54.504114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41c11-3318-49dd-afa6-ec669b3b5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:54.504830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41c11-3318-49dd-afa6-ec669b3b5564 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:54.505077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41c11-3318-49dd-afa6-ec669b3b5564 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:54.505348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41c11-3318-49dd-afa6-ec669b3b5564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:54.557400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d24c67-2835-49c2-9ada-4de090dca80d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:54.613908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d41c11-3318-49dd-afa6-ec669b3b5564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:54.615451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d41c11-3318-49dd-afa6-ec669b3b5564 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:54.764605 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d24c67-2835-49c2-9ada-4de090dca80d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:54.766306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 82/157] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:38:54.767316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41c11-3318-49dd-afa6-ec669b3b5564 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:54.860145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14fe57-7bba-46db-9f5b-774a489bcfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:54.860987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14fe57-7bba-46db-9f5b-774a489bcfe5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:54.861277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14fe57-7bba-46db-9f5b-774a489bcfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:54.861556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14fe57-7bba-46db-9f5b-774a489bcfe5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:54.875700 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41c11-3318-49dd-afa6-ec669b3b5564 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:54.883779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14fe57-7bba-46db-9f5b-774a489bcfe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:54.895262 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-2e14fe57-7bba-46db-9f5b-774a489bcfe5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 22 19:38:54.896758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 76/158] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:38:54.903419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14fe57-7bba-46db-9f5b-774a489bcfe5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:54.914963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d331c1-e017-46f6-b81e-6d7743c975df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:54.916102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d331c1-e017-46f6-b81e-6d7743c975df None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:54.916443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d331c1-e017-46f6-b81e-6d7743c975df None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:54.916717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d331c1-e017-46f6-b81e-6d7743c975df None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:54.918081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d331c1-e017-46f6-b81e-6d7743c975df None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:54.919565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d331c1-e017-46f6-b81e-6d7743c975df None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:54.922556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 83/159] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:54 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:54.929496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d331c1-e017-46f6-b81e-6d7743c975df None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:55.055429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d331c1-e017-46f6-b81e-6d7743c975df None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:55.094968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0fda1-e286-4ea2-91f4-759604dfb681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:55.095639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0fda1-e286-4ea2-91f4-759604dfb681 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.096112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0fda1-e286-4ea2-91f4-759604dfb681 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.096397 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0fda1-e286-4ea2-91f4-759604dfb681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:55.097242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0fda1-e286-4ea2-91f4-759604dfb681 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user.id=686bfe5266224121af654efbb4f624b9) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:55.097556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0fda1-e286-4ea2-91f4-759604dfb681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:55.099473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0fda1-e286-4ea2-91f4-759604dfb681 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:55.106532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 84/160] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:38:54 2022] GET /identity/v3/role_assignments?user.id=686bfe5266224121af654efbb4f624b9&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:55.149748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14fe57-7bba-46db-9f5b-774a489bcfe5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:55.201348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dab00-255c-427d-bec7-b411c0ff12ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:55.203553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dab00-255c-427d-bec7-b411c0ff12ce None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.203553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dab00-255c-427d-bec7-b411c0ff12ce None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.203553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dab00-255c-427d-bec7-b411c0ff12ce None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:55.203553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dab00-255c-427d-bec7-b411c0ff12ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:55.203553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dab00-255c-427d-bec7-b411c0ff12ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:55.206122 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dab00-255c-427d-bec7-b411c0ff12ce None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:55.219187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 77/161] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:38:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:55.226106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0fda1-e286-4ea2-91f4-759604dfb681 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:55.295994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6cc15-79e5-4a2c-bcbc-d844fed06ca7 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.296333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6cc15-79e5-4a2c-bcbc-d844fed06ca7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.296554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6cc15-79e5-4a2c-bcbc-d844fed06ca7 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:55.298728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 78/162] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:38:55.305135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf171ac-877b-495e-9b52-8dfe2bfbc4ab None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.305514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf171ac-877b-495e-9b52-8dfe2bfbc4ab None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.305712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf171ac-877b-495e-9b52-8dfe2bfbc4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:55.354885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7cf171ac-877b-495e-9b52-8dfe2bfbc4ab None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:55.355829 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7cf171ac-877b-495e-9b52-8dfe2bfbc4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:55.368600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0fda1-e286-4ea2-91f4-759604dfb681 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:55.407615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee4095-54a6-4d73-8893-8908cdfaa9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:55.409201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee4095-54a6-4d73-8893-8908cdfaa9fa None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.409682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee4095-54a6-4d73-8893-8908cdfaa9fa None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.410185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee4095-54a6-4d73-8893-8908cdfaa9fa None admin] PATH_INFO: `/v3/users/0291274e337040b4bdbc8d05c5e326c8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:55.411753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee4095-54a6-4d73-8893-8908cdfaa9fa None admin] RBAC: Authorizing `identity:get_user(user_id=0291274e337040b4bdbc8d05c5e326c8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:55.413497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee4095-54a6-4d73-8893-8908cdfaa9fa None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:55.415491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 85/163] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:55 2022] GET /identity/v3/users/0291274e337040b4bdbc8d05c5e326c8 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:55.424933 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee4095-54a6-4d73-8893-8908cdfaa9fa None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:55.486257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 79/164] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:55.539341 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf171ac-877b-495e-9b52-8dfe2bfbc4ab None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:55.612123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee4095-54a6-4d73-8893-8908cdfaa9fa None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:55.699378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eefe5f-f808-4827-9b13-3a3ee34cf826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:55.700283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eefe5f-f808-4827-9b13-3a3ee34cf826 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.700568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eefe5f-f808-4827-9b13-3a3ee34cf826 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.700842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eefe5f-f808-4827-9b13-3a3ee34cf826 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:55.702138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eefe5f-f808-4827-9b13-3a3ee34cf826 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:55.703643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eefe5f-f808-4827-9b13-3a3ee34cf826 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:55.706710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 86/165] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:55 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:55.725967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eefe5f-f808-4827-9b13-3a3ee34cf826 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:55.772753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf171ac-877b-495e-9b52-8dfe2bfbc4ab None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:55.868779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eefe5f-f808-4827-9b13-3a3ee34cf826 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:55.906550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0030d0-4853-4d38-836f-716323acbf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:55.908411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0030d0-4853-4d38-836f-716323acbf74 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.909399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0030d0-4853-4d38-836f-716323acbf74 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.910275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c65a-7232-4cab-abda-fdd9a16616a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:55.911405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c65a-7232-4cab-abda-fdd9a16616a9 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.911914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0030d0-4853-4d38-836f-716323acbf74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:55.912998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c65a-7232-4cab-abda-fdd9a16616a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.913676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c65a-7232-4cab-abda-fdd9a16616a9 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/users/0291274e337040b4bdbc8d05c5e326c8/roles/8970adb53a594bf68973ee9679c03bcd` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:55.921360 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c65a-7232-4cab-abda-fdd9a16616a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user_id=0291274e337040b4bdbc8d05c5e326c8, role_id=8970adb53a594bf68973ee9679c03bcd)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:55.925470 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c65a-7232-4cab-abda-fdd9a16616a9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:55.941908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0030d0-4853-4d38-836f-716323acbf74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:55.957605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 87/166] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:38:55 2022] PUT /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/users/0291274e337040b4bdbc8d05c5e326c8/roles/8970adb53a594bf68973ee9679c03bcd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:38:55.959579 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148cb0e-3029-472c-9c85-ce7384ee7f0d None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.960097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148cb0e-3029-472c-9c85-ce7384ee7f0d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.960572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148cb0e-3029-472c-9c85-ce7384ee7f0d None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:55.963689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-ff0030d0-4853-4d38-836f-716323acbf74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:38:55.966108 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 88/167] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:55.967884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 80/168] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:38:55.976220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148cb0e-3029-472c-9c85-ce7384ee7f0d None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:55.987848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb42bd7-4c18-4349-ae96-d77666bee9d7 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:55.988808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb42bd7-4c18-4349-ae96-d77666bee9d7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:55.989531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb42bd7-4c18-4349-ae96-d77666bee9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:56.051894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-ceb42bd7-4c18-4349-ae96-d77666bee9d7 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:56.054400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ceb42bd7-4c18-4349-ae96-d77666bee9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:56.296119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 81/169] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:38:56.313122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148cb0e-3029-472c-9c85-ce7384ee7f0d None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:56.351889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb42bd7-4c18-4349-ae96-d77666bee9d7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:56.398113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08cccd-618a-4db3-9e4a-da70b542e561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:56.400146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08cccd-618a-4db3-9e4a-da70b542e561 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:56.400945 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08cccd-618a-4db3-9e4a-da70b542e561 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:56.401768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08cccd-618a-4db3-9e4a-da70b542e561 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:56.409722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08cccd-618a-4db3-9e4a-da70b542e561 None admin] RBAC: Adding query filter params (name=member) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:56.411680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08cccd-618a-4db3-9e4a-da70b542e561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:56.415828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08cccd-618a-4db3-9e4a-da70b542e561 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:56.446083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 89/170] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:56.456235 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08cccd-618a-4db3-9e4a-da70b542e561 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:56.693983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb42bd7-4c18-4349-ae96-d77666bee9d7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:56.797427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08cccd-618a-4db3-9e4a-da70b542e561 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:56.804749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d6d24-0570-460a-a4e8-a7a98c85d1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:56.806626 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d6d24-0570-460a-a4e8-a7a98c85d1fa None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:56.807408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d6d24-0570-460a-a4e8-a7a98c85d1fa None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:56.808177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d6d24-0570-460a-a4e8-a7a98c85d1fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:56.860748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d6d24-0570-460a-a4e8-a7a98c85d1fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:56.877404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb367915-141e-4975-8823-92fe87100436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:56.878406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367915-141e-4975-8823-92fe87100436 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:56.878650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367915-141e-4975-8823-92fe87100436 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:56.878927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367915-141e-4975-8823-92fe87100436 None admin] PATH_INFO: `/v3/users/0c7219524d1b4afd8d1aea23de18a164` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:56.882843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb367915-141e-4975-8823-92fe87100436 None admin] RBAC: Authorizing `identity:get_user(user_id=0c7219524d1b4afd8d1aea23de18a164)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:56.884364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb367915-141e-4975-8823-92fe87100436 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:56.893286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 90/171] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:56 2022] GET /identity/v3/users/0c7219524d1b4afd8d1aea23de18a164 => generated 275 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:56.894496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-177d6d24-0570-460a-a4e8-a7a98c85d1fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:38:56.895317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb367915-141e-4975-8823-92fe87100436 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:56.897829 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 82/172] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 547 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:38:56.908119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d6d24-0570-460a-a4e8-a7a98c85d1fa None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:57.058498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb367915-141e-4975-8823-92fe87100436 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:57.095985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d6d24-0570-460a-a4e8-a7a98c85d1fa None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:57.106845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9b513-3258-4443-90cb-056130d6cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:57.107532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9b513-3258-4443-90cb-056130d6cd78 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:57.107816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9b513-3258-4443-90cb-056130d6cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:57.108093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9b513-3258-4443-90cb-056130d6cd78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:57.166539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87957-96a0-47f5-a058-d6fd80491a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:57.167668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87957-96a0-47f5-a058-d6fd80491a0f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:57.168142 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87957-96a0-47f5-a058-d6fd80491a0f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:57.168604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87957-96a0-47f5-a058-d6fd80491a0f None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:57.169571 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d87957-96a0-47f5-a058-d6fd80491a0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:57.182767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d87957-96a0-47f5-a058-d6fd80491a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:57.184646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d87957-96a0-47f5-a058-d6fd80491a0f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:57.206966 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 83/173] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:38:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:57.212440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87957-96a0-47f5-a058-d6fd80491a0f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:57.283164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9b513-3258-4443-90cb-056130d6cd78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:57.285032 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9b513-3258-4443-90cb-056130d6cd78 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:57.517591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87957-96a0-47f5-a058-d6fd80491a0f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:57.553336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 91/174] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:38:57.574934 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9b513-3258-4443-90cb-056130d6cd78 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:57.600247 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7970b-7e28-4eb6-8ae0-462784b59adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:57.602308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7970b-7e28-4eb6-8ae0-462784b59adf None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:57.603119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7970b-7e28-4eb6-8ae0-462784b59adf None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:57.603976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7970b-7e28-4eb6-8ae0-462784b59adf None admin] PATH_INFO: `/v3/users/0c7219524d1b4afd8d1aea23de18a164` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:57.608606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7970b-7e28-4eb6-8ae0-462784b59adf None admin] RBAC: Authorizing `identity:get_user(user_id=0c7219524d1b4afd8d1aea23de18a164)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:57.614521 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7970b-7e28-4eb6-8ae0-462784b59adf None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:57.620160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 84/175] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:57 2022] GET /identity/v3/users/0c7219524d1b4afd8d1aea23de18a164 => generated 275 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:57.643363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7970b-7e28-4eb6-8ae0-462784b59adf None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:57.864240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9b513-3258-4443-90cb-056130d6cd78 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:57.866781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7970b-7e28-4eb6-8ae0-462784b59adf None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:57.907166 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f195f6-8687-4ff9-b881-b9fa1536328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:57.907840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f195f6-8687-4ff9-b881-b9fa1536328b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:57.908115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f195f6-8687-4ff9-b881-b9fa1536328b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:57.908384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f195f6-8687-4ff9-b881-b9fa1536328b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:57.944265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55e627-e12f-4848-b43d-4c9594f144a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:57.945482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55e627-e12f-4848-b43d-4c9594f144a2 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:57.945799 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55e627-e12f-4848-b43d-4c9594f144a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:57.947109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55e627-e12f-4848-b43d-4c9594f144a2 None admin] PATH_INFO: `/v3/projects/b0c2be7a4e4d45a0a6b56d87c4aa7ba4` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:57.950931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55e627-e12f-4848-b43d-4c9594f144a2 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c2be7a4e4d45a0a6b56d87c4aa7ba4)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:57.952446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55e627-e12f-4848-b43d-4c9594f144a2 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:57.954596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 92/176] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:57 2022] GET /identity/v3/projects/b0c2be7a4e4d45a0a6b56d87c4aa7ba4 => generated 312 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:57.964720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1dcad-ea30-4b08-b24e-4c89952eccdf None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:57.965106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1dcad-ea30-4b08-b24e-4c89952eccdf None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:57.965338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1dcad-ea30-4b08-b24e-4c89952eccdf None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:57.967619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 93/177] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:57.974246 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1dcad-ea30-4b08-b24e-4c89952eccdf None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:58.037478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f195f6-8687-4ff9-b881-b9fa1536328b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:58.039031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f195f6-8687-4ff9-b881-b9fa1536328b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:58.156139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 85/178] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:38:58.157232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa84713-2b3a-4130-ad64-287e8649aa5f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:58.157514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa84713-2b3a-4130-ad64-287e8649aa5f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:58.157783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa84713-2b3a-4130-ad64-287e8649aa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:58.176444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-9aa84713-2b3a-4130-ad64-287e8649aa5f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:58.177652 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9aa84713-2b3a-4130-ad64-287e8649aa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:58.256057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 86/179] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:58.257026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa84713-2b3a-4130-ad64-287e8649aa5f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:58.298776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1dcad-ea30-4b08-b24e-4c89952eccdf None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:58.370022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa84713-2b3a-4130-ad64-287e8649aa5f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:58.394878 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21db33-62c3-4cdf-9420-94133a8cf659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:58.395591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21db33-62c3-4cdf-9420-94133a8cf659 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:58.395880 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21db33-62c3-4cdf-9420-94133a8cf659 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:58.396160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21db33-62c3-4cdf-9420-94133a8cf659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:58.397040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21db33-62c3-4cdf-9420-94133a8cf659 None admin] RBAC: Adding query filter params (role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=b0c2be7a4e4d45a0a6b56d87c4aa7ba4, user.id=0c7219524d1b4afd8d1aea23de18a164) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:58.397357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21db33-62c3-4cdf-9420-94133a8cf659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:58.398926 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21db33-62c3-4cdf-9420-94133a8cf659 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:58.409657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 94/180] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:38:57 2022] GET /identity/v3/role_assignments?user.id=0c7219524d1b4afd8d1aea23de18a164&scope.project.id=b0c2be7a4e4d45a0a6b56d87c4aa7ba4&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 608 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:58.410676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21db33-62c3-4cdf-9420-94133a8cf659 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:58.412454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b170ef9-d511-4294-8a0a-1275b84b2b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:58.413355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b170ef9-d511-4294-8a0a-1275b84b2b7a None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:58.413631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b170ef9-d511-4294-8a0a-1275b84b2b7a None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:58.413914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b170ef9-d511-4294-8a0a-1275b84b2b7a None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:58.420356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b170ef9-d511-4294-8a0a-1275b84b2b7a None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:58.423299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b170ef9-d511-4294-8a0a-1275b84b2b7a None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:58.428260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 87/181] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:58 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:58.438203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b170ef9-d511-4294-8a0a-1275b84b2b7a None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:58.624086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b170ef9-d511-4294-8a0a-1275b84b2b7a None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:58.678780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9f6ad-067f-4276-a9bf-b37d275a7551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:58.679820 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9f6ad-067f-4276-a9bf-b37d275a7551 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:58.680299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9f6ad-067f-4276-a9bf-b37d275a7551 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:58.680716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9f6ad-067f-4276-a9bf-b37d275a7551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:58.683263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9f6ad-067f-4276-a9bf-b37d275a7551 None admin] RBAC: Adding query filter params (role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user.id=0c7219524d1b4afd8d1aea23de18a164) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:58.683656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9f6ad-067f-4276-a9bf-b37d275a7551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:58.685970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9f6ad-067f-4276-a9bf-b37d275a7551 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:58.694372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 88/182] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:38:58 2022] GET /identity/v3/role_assignments?user.id=0c7219524d1b4afd8d1aea23de18a164&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:58.696074 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926cae9-4e4d-4c0d-ab58-1c8c0dab2f63 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:58.696542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926cae9-4e4d-4c0d-ab58-1c8c0dab2f63 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:58.697070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926cae9-4e4d-4c0d-ab58-1c8c0dab2f63 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:58.701760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 89/183] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:58.702135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21db33-62c3-4cdf-9420-94133a8cf659 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:58.717693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34288f-e2ea-48b7-8fc3-2da25b6f77ab None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:58.718220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34288f-e2ea-48b7-8fc3-2da25b6f77ab None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:58.718709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34288f-e2ea-48b7-8fc3-2da25b6f77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:58.753015 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-df34288f-e2ea-48b7-8fc3-2da25b6f77ab None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:58.754275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-df34288f-e2ea-48b7-8fc3-2da25b6f77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:58.808507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571f841-d41c-4d63-a9b6-0e6d7e9eac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:58.809726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571f841-d41c-4d63-a9b6-0e6d7e9eac74 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:58.810234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571f841-d41c-4d63-a9b6-0e6d7e9eac74 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:58.810747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571f841-d41c-4d63-a9b6-0e6d7e9eac74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:58.830654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571f841-d41c-4d63-a9b6-0e6d7e9eac74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:58.838811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-b571f841-d41c-4d63-a9b6-0e6d7e9eac74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:38:58.840786 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 95/184] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:58.851264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571f841-d41c-4d63-a9b6-0e6d7e9eac74 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:58.965824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 90/185] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:58.969497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571f841-d41c-4d63-a9b6-0e6d7e9eac74 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:59.004493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34288f-e2ea-48b7-8fc3-2da25b6f77ab None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:59.081513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115126-4ae8-4e48-9bbf-bbeaf35a74be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:59.082743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115126-4ae8-4e48-9bbf-bbeaf35a74be None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.083134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115126-4ae8-4e48-9bbf-bbeaf35a74be None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.083509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115126-4ae8-4e48-9bbf-bbeaf35a74be None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.085824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00115126-4ae8-4e48-9bbf-bbeaf35a74be None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:38:59.085824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00115126-4ae8-4e48-9bbf-bbeaf35a74be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:59.091231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00115126-4ae8-4e48-9bbf-bbeaf35a74be None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:59.105678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 96/186] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:59.107951 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1d606-2e62-4112-b4cc-bb26066f9ad4 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.108236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1d606-2e62-4112-b4cc-bb26066f9ad4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.109186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1d606-2e62-4112-b4cc-bb26066f9ad4 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.111270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 97/187] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:59.115716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1d606-2e62-4112-b4cc-bb26066f9ad4 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:59.204612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34288f-e2ea-48b7-8fc3-2da25b6f77ab None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:59.270011 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1d606-2e62-4112-b4cc-bb26066f9ad4 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:59.270268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd232c7-1136-436f-98bd-13bc81f08200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:59.271309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd232c7-1136-436f-98bd-13bc81f08200 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.271749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd232c7-1136-436f-98bd-13bc81f08200 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.272282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd232c7-1136-436f-98bd-13bc81f08200 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.275747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd232c7-1136-436f-98bd-13bc81f08200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:59.278378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd232c7-1136-436f-98bd-13bc81f08200 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:59.281561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 91/188] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:38:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:38:59.284608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f681849-69e3-460a-b78b-62abb9951688 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.285118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f681849-69e3-460a-b78b-62abb9951688 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.285596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f681849-69e3-460a-b78b-62abb9951688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.307781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4f681849-69e3-460a-b78b-62abb9951688 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:59.309050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4f681849-69e3-460a-b78b-62abb9951688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:59.347758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316c08d-5924-4548-b1ad-c2e4c5f17f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:59.349931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316c08d-5924-4548-b1ad-c2e4c5f17f24 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.350250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316c08d-5924-4548-b1ad-c2e4c5f17f24 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.350529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316c08d-5924-4548-b1ad-c2e4c5f17f24 None admin] PATH_INFO: `/v3/users/74c5c3dbd1134718a124fdc3de154e1d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.368194 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316c08d-5924-4548-b1ad-c2e4c5f17f24 None admin] RBAC: Authorizing `identity:get_user(user_id=74c5c3dbd1134718a124fdc3de154e1d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:59.370127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316c08d-5924-4548-b1ad-c2e4c5f17f24 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:59.371976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 98/189] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:38:59 2022] GET /identity/v3/users/74c5c3dbd1134718a124fdc3de154e1d => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:38:59.379761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316c08d-5924-4548-b1ad-c2e4c5f17f24 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:59.403600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 92/190] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:59.404926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f681849-69e3-460a-b78b-62abb9951688 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:59.539129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f681849-69e3-460a-b78b-62abb9951688 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:59.570929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316c08d-5924-4548-b1ad-c2e4c5f17f24 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:59.578857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881434b-002f-4c46-a8ce-ed742507366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:59.579536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881434b-002f-4c46-a8ce-ed742507366f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.579888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881434b-002f-4c46-a8ce-ed742507366f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.580165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881434b-002f-4c46-a8ce-ed742507366f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.629001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349acc4-cc9c-4d43-9607-e9067f545ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:59.629693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349acc4-cc9c-4d43-9607-e9067f545ec4 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.630008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349acc4-cc9c-4d43-9607-e9067f545ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.630293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349acc4-cc9c-4d43-9607-e9067f545ec4 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.631031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349acc4-cc9c-4d43-9607-e9067f545ec4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:59.632537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349acc4-cc9c-4d43-9607-e9067f545ec4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:59.653551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 99/191] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:38:59 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:38:59.667069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349acc4-cc9c-4d43-9607-e9067f545ec4 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:59.679108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881434b-002f-4c46-a8ce-ed742507366f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:38:59.682402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881434b-002f-4c46-a8ce-ed742507366f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:38:59.792738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349acc4-cc9c-4d43-9607-e9067f545ec4 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:38:59.832829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d50f0-6bab-4dba-8353-9870a4fa074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:38:59.833673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d50f0-6bab-4dba-8353-9870a4fa074a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.833970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d50f0-6bab-4dba-8353-9870a4fa074a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.834252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d50f0-6bab-4dba-8353-9870a4fa074a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.846941 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d50f0-6bab-4dba-8353-9870a4fa074a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:38:59.855174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-927d50f0-6bab-4dba-8353-9870a4fa074a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:38:59.856600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 100/192] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:38:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:38:59.857852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530937-6326-4729-92da-2c6252ebe468 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.858155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530937-6326-4729-92da-2c6252ebe468 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.858433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530937-6326-4729-92da-2c6252ebe468 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.860425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 101/193] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:38:59.866433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bacd1-5613-45f8-8641-e6b95cfe7010 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:38:59.866716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bacd1-5613-45f8-8641-e6b95cfe7010 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:38:59.866916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 93/194] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:38:59.867930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881434b-002f-4c46-a8ce-ed742507366f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:38:59.868664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bacd1-5613-45f8-8641-e6b95cfe7010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:38:59.888660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c68bacd1-5613-45f8-8641-e6b95cfe7010 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:38:59.890247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c68bacd1-5613-45f8-8641-e6b95cfe7010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:38:59.983477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 102/195] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:38:59.986171 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bacd1-5613-45f8-8641-e6b95cfe7010 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:00.015849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881434b-002f-4c46-a8ce-ed742507366f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:00.077655 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c4232-4492-4ec8-810f-ab4669aa8d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:00.078477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c4232-4492-4ec8-810f-ab4669aa8d6e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:00.078757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c4232-4492-4ec8-810f-ab4669aa8d6e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:00.079311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c4232-4492-4ec8-810f-ab4669aa8d6e None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:00.080085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c4232-4492-4ec8-810f-ab4669aa8d6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:00.080388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c4232-4492-4ec8-810f-ab4669aa8d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:00.083351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c4232-4492-4ec8-810f-ab4669aa8d6e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:00.093307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 94/196] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:38:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:00.094672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c4232-4492-4ec8-810f-ab4669aa8d6e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:00.187880 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bacd1-5613-45f8-8641-e6b95cfe7010 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:00.232209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c4232-4492-4ec8-810f-ab4669aa8d6e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:00.250227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad4a3-ea71-4a31-a2f9-48d038d75c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:00.251741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad4a3-ea71-4a31-a2f9-48d038d75c5c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:00.252217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad4a3-ea71-4a31-a2f9-48d038d75c5c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:00.252702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ad4a3-ea71-4a31-a2f9-48d038d75c5c None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:00.255030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ad4a3-ea71-4a31-a2f9-48d038d75c5c None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:00.257809 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ad4a3-ea71-4a31-a2f9-48d038d75c5c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:00.261789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 103/197] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:38:59 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:00.263284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad4a3-ea71-4a31-a2f9-48d038d75c5c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:00.279233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626efc03-d83d-4db0-97a3-0fa2c0d61e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:00.280088 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626efc03-d83d-4db0-97a3-0fa2c0d61e2b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:00.280374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626efc03-d83d-4db0-97a3-0fa2c0d61e2b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:00.280653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626efc03-d83d-4db0-97a3-0fa2c0d61e2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:00.295968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626efc03-d83d-4db0-97a3-0fa2c0d61e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:00.303405 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-626efc03-d83d-4db0-97a3-0fa2c0d61e2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 22 19:39:00.304786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 95/198] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:00.305518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626efc03-d83d-4db0-97a3-0fa2c0d61e2b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:00.418733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626efc03-d83d-4db0-97a3-0fa2c0d61e2b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:00.455613 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe050379-2cf1-4e5d-9afb-1438c01c40b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:00.456304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe050379-2cf1-4e5d-9afb-1438c01c40b8 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:00.456583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe050379-2cf1-4e5d-9afb-1438c01c40b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:00.456848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ad4a3-ea71-4a31-a2f9-48d038d75c5c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:00.457016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe050379-2cf1-4e5d-9afb-1438c01c40b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:00.457700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe050379-2cf1-4e5d-9afb-1438c01c40b8 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=2d0172f0deac4b64babafdb092e05fd8, user.id=74c5c3dbd1134718a124fdc3de154e1d) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:00.458050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe050379-2cf1-4e5d-9afb-1438c01c40b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:00.462098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe050379-2cf1-4e5d-9afb-1438c01c40b8 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:00.470425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 96/199] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:00 2022] GET /identity/v3/role_assignments?user.id=74c5c3dbd1134718a124fdc3de154e1d&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:00.471257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe050379-2cf1-4e5d-9afb-1438c01c40b8 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:00.545204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd725e0-d7e8-4cef-b8eb-282892ee877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:00.546923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd725e0-d7e8-4cef-b8eb-282892ee877b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:00.547414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd725e0-d7e8-4cef-b8eb-282892ee877b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:00.547867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd725e0-d7e8-4cef-b8eb-282892ee877b None admin] PATH_INFO: `/v3/users/74c5c3dbd1134718a124fdc3de154e1d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:00.555521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd725e0-d7e8-4cef-b8eb-282892ee877b None admin] RBAC: Authorizing `identity:get_user(user_id=74c5c3dbd1134718a124fdc3de154e1d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:00.558330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd725e0-d7e8-4cef-b8eb-282892ee877b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:00.566486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 104/200] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:00 2022] GET /identity/v3/users/74c5c3dbd1134718a124fdc3de154e1d => generated 283 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:00.571148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd725e0-d7e8-4cef-b8eb-282892ee877b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:00.589348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe050379-2cf1-4e5d-9afb-1438c01c40b8 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:00.632454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211cedc-f86c-4acf-832a-49b5bc8a8e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:00.633157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211cedc-f86c-4acf-832a-49b5bc8a8e38 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:00.633430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211cedc-f86c-4acf-832a-49b5bc8a8e38 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:00.633699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211cedc-f86c-4acf-832a-49b5bc8a8e38 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:00.634709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211cedc-f86c-4acf-832a-49b5bc8a8e38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:00.635180 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211cedc-f86c-4acf-832a-49b5bc8a8e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:00.636914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211cedc-f86c-4acf-832a-49b5bc8a8e38 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:00.646679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 97/201] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:00.652654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211cedc-f86c-4acf-832a-49b5bc8a8e38 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:00.799499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd725e0-d7e8-4cef-b8eb-282892ee877b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:00.855913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196f663-c7dc-4131-936b-64245f0ab482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:00.856992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196f663-c7dc-4131-936b-64245f0ab482 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:00.857469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196f663-c7dc-4131-936b-64245f0ab482 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:00.857931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196f663-c7dc-4131-936b-64245f0ab482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:00.877040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211cedc-f86c-4acf-832a-49b5bc8a8e38 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:00.928723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994e698-4622-4c53-a20b-230aa7ac1f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:00.930145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994e698-4622-4c53-a20b-230aa7ac1f1f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:00.930426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994e698-4622-4c53-a20b-230aa7ac1f1f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:00.930696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994e698-4622-4c53-a20b-230aa7ac1f1f None admin] PATH_INFO: `/v3/users/0291274e337040b4bdbc8d05c5e326c8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:00.932451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994e698-4622-4c53-a20b-230aa7ac1f1f None admin] RBAC: Authorizing `identity:get_user(user_id=0291274e337040b4bdbc8d05c5e326c8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:00.934238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994e698-4622-4c53-a20b-230aa7ac1f1f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:00.936892 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 98/202] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:00 2022] GET /identity/v3/users/0291274e337040b4bdbc8d05c5e326c8 => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:00.942697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994e698-4622-4c53-a20b-230aa7ac1f1f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:01.038022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196f663-c7dc-4131-936b-64245f0ab482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:01.039832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196f663-c7dc-4131-936b-64245f0ab482 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:01.126276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994e698-4622-4c53-a20b-230aa7ac1f1f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:01.170401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f9ff-2238-4695-a4bb-9a76f83b48bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:01.171069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f9ff-2238-4695-a4bb-9a76f83b48bf None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:01.171346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f9ff-2238-4695-a4bb-9a76f83b48bf None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:01.171617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f9ff-2238-4695-a4bb-9a76f83b48bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:01.277064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158f9ff-2238-4695-a4bb-9a76f83b48bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:01.278968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158f9ff-2238-4695-a4bb-9a76f83b48bf None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:01.281211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 105/203] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:01.286588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196f663-c7dc-4131-936b-64245f0ab482 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:01.394956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 99/204] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:01.417433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f9ff-2238-4695-a4bb-9a76f83b48bf None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:01.529057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f9ff-2238-4695-a4bb-9a76f83b48bf None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:01.556405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196f663-c7dc-4131-936b-64245f0ab482 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:01.576995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ad58-e6c9-44f0-97c1-ffd197e7debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:01.577924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ad58-e6c9-44f0-97c1-ffd197e7debb None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:01.578235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ad58-e6c9-44f0-97c1-ffd197e7debb None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:01.578515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ad58-e6c9-44f0-97c1-ffd197e7debb None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:01.580518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02ad58-e6c9-44f0-97c1-ffd197e7debb None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:01.582010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02ad58-e6c9-44f0-97c1-ffd197e7debb None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:01.583772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 100/205] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:01 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:01.590796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ad58-e6c9-44f0-97c1-ffd197e7debb None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:01.640876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb472b-8c4e-42d4-946b-6069fed97e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:01.641777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb472b-8c4e-42d4-946b-6069fed97e29 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:01.642096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb472b-8c4e-42d4-946b-6069fed97e29 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:01.642375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb472b-8c4e-42d4-946b-6069fed97e29 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:01.647087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb472b-8c4e-42d4-946b-6069fed97e29 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:01.648519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb472b-8c4e-42d4-946b-6069fed97e29 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:01.653747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 106/206] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:01 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:01.659057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb472b-8c4e-42d4-946b-6069fed97e29 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:01.805536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ad58-e6c9-44f0-97c1-ffd197e7debb None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:01.892115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc2fc1-1e8e-4654-8a83-36f12e27778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:01.893345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc2fc1-1e8e-4654-8a83-36f12e27778a None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:01.893835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc2fc1-1e8e-4654-8a83-36f12e27778a None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:01.894349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc2fc1-1e8e-4654-8a83-36f12e27778a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:01.896005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc2fc1-1e8e-4654-8a83-36f12e27778a None admin] RBAC: Adding query filter params (role.id=8970adb53a594bf68973ee9679c03bcd, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b, user.id=0291274e337040b4bdbc8d05c5e326c8) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:01.896556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc2fc1-1e8e-4654-8a83-36f12e27778a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:01.902102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc2fc1-1e8e-4654-8a83-36f12e27778a None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:01.923673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 101/207] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:01 2022] GET /identity/v3/role_assignments?user.id=0291274e337040b4bdbc8d05c5e326c8&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=8970adb53a594bf68973ee9679c03bcd => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:01.935179 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb472b-8c4e-42d4-946b-6069fed97e29 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:02.012130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886e936-0a01-4414-be49-945824f5a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:02.013301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e936-0a01-4414-be49-945824f5a771 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:02.013780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e936-0a01-4414-be49-945824f5a771 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:02.014308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e936-0a01-4414-be49-945824f5a771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:02.016003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886e936-0a01-4414-be49-945824f5a771 None admin] RBAC: Adding query filter params (role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=2d0172f0deac4b64babafdb092e05fd8, user.id=74c5c3dbd1134718a124fdc3de154e1d) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:02.016547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886e936-0a01-4414-be49-945824f5a771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:02.019475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886e936-0a01-4414-be49-945824f5a771 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:02.035994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 107/208] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:01 2022] GET /identity/v3/role_assignments?user.id=74c5c3dbd1134718a124fdc3de154e1d&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 259 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:02.849363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaeccb-0e5f-4120-84d8-6b7596093f75 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:02.850848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaeccb-0e5f-4120-84d8-6b7596093f75 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:02.851649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaeccb-0e5f-4120-84d8-6b7596093f75 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:02.857593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 102/209] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:02.865415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e55b3-de71-4aa0-af2e-88a5ce0a06ab None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:02.866891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e55b3-de71-4aa0-af2e-88a5ce0a06ab None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:02.867667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e55b3-de71-4aa0-af2e-88a5ce0a06ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:02.897181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-977e55b3-de71-4aa0-af2e-88a5ce0a06ab None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:02.899690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-977e55b3-de71-4aa0-af2e-88a5ce0a06ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:03.038085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 108/210] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:03.076808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaeccb-0e5f-4120-84d8-6b7596093f75 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:03.299063 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbdbd5-e916-47cc-bc3e-a952415ddc26 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:03.299743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbdbd5-e916-47cc-bc3e-a952415ddc26 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:03.300225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbdbd5-e916-47cc-bc3e-a952415ddc26 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:03.300393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaeccb-0e5f-4120-84d8-6b7596093f75 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:03.302618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 109/211] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:03.311060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091fe24-210d-44f9-86cc-3ba54e6695e9 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:03.311679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091fe24-210d-44f9-86cc-3ba54e6695e9 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:03.312396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091fe24-210d-44f9-86cc-3ba54e6695e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:03.330983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3091fe24-210d-44f9-86cc-3ba54e6695e9 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:03.332547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3091fe24-210d-44f9-86cc-3ba54e6695e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:03.380727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d4d0a-cf87-4365-a5c9-33b0ea9d12e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:03.382293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4d0a-cf87-4365-a5c9-33b0ea9d12e7 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:03.382407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4d0a-cf87-4365-a5c9-33b0ea9d12e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:03.382792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4d0a-cf87-4365-a5c9-33b0ea9d12e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:03.403241 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d4d0a-cf87-4365-a5c9-33b0ea9d12e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:03.417408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a64d4d0a-cf87-4365-a5c9-33b0ea9d12e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:03.424222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 103/212] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:03.426081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d4d0a-cf87-4365-a5c9-33b0ea9d12e7 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:03.445964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 110/213] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:03.464216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091fe24-210d-44f9-86cc-3ba54e6695e9 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:03.591814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091fe24-210d-44f9-86cc-3ba54e6695e9 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:03.616423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d4d0a-cf87-4365-a5c9-33b0ea9d12e7 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:03.638392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5189059-76b8-4896-8de3-77a1b51afcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:03.639227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5189059-76b8-4896-8de3-77a1b51afcbc None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:03.639501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5189059-76b8-4896-8de3-77a1b51afcbc None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:03.639776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5189059-76b8-4896-8de3-77a1b51afcbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:03.641240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5189059-76b8-4896-8de3-77a1b51afcbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:03.642773 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5189059-76b8-4896-8de3-77a1b51afcbc None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:03.644461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 111/214] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:03.646093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111ffb-906a-4c70-a075-313652c00d98 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:03.646093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111ffb-906a-4c70-a075-313652c00d98 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:03.646364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111ffb-906a-4c70-a075-313652c00d98 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:03.648115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 112/215] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:03.655079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d5815-744e-49f0-b95e-848323c16019 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:03.655475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d5815-744e-49f0-b95e-848323c16019 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:03.655661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d5815-744e-49f0-b95e-848323c16019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:03.673402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04d3af-93b9-4662-9ff4-74658422b64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:03.674437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d3af-93b9-4662-9ff4-74658422b64d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:03.674852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8c2d5815-744e-49f0-b95e-848323c16019 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:03.675009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d3af-93b9-4662-9ff4-74658422b64d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:03.675428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d3af-93b9-4662-9ff4-74658422b64d None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:03.676309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04d3af-93b9-4662-9ff4-74658422b64d None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:03.676743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8c2d5815-744e-49f0-b95e-848323c16019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:03.676894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04d3af-93b9-4662-9ff4-74658422b64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:03.679167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04d3af-93b9-4662-9ff4-74658422b64d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:03.689772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 104/216] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:03.691500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04d3af-93b9-4662-9ff4-74658422b64d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:03.764780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 113/217] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:03.771045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d5815-744e-49f0-b95e-848323c16019 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:03.868435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04d3af-93b9-4662-9ff4-74658422b64d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:03.920214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e335-c893-48af-a34c-368de79d1a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:03.921179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e335-c893-48af-a34c-368de79d1a34 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:03.921579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e335-c893-48af-a34c-368de79d1a34 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:03.922005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e335-c893-48af-a34c-368de79d1a34 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:03.924469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e335-c893-48af-a34c-368de79d1a34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:03.926336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e335-c893-48af-a34c-368de79d1a34 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:03.942856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d5815-744e-49f0-b95e-848323c16019 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:03.963844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 105/218] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:39:03 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:39:03.965646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e335-c893-48af-a34c-368de79d1a34 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:04.032747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc32613-be9f-4419-a6f6-a859154bd9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:04.034520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc32613-be9f-4419-a6f6-a859154bd9d8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:04.035504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc32613-be9f-4419-a6f6-a859154bd9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:04.035504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc32613-be9f-4419-a6f6-a859154bd9d8 None admin] PATH_INFO: `/v3/users/1731c519890a41448304e6c96dbda95f` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:04.070520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc32613-be9f-4419-a6f6-a859154bd9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=1731c519890a41448304e6c96dbda95f)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:04.079871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc32613-be9f-4419-a6f6-a859154bd9d8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:04.083378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 114/219] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:03 2022] GET /identity/v3/users/1731c519890a41448304e6c96dbda95f => generated 297 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:04.092553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc32613-be9f-4419-a6f6-a859154bd9d8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:04.191750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e335-c893-48af-a34c-368de79d1a34 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:04.271971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc32613-be9f-4419-a6f6-a859154bd9d8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:04.275934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e064a-05f7-4337-b1ed-b86c6cd8b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:04.276795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e064a-05f7-4337-b1ed-b86c6cd8b855 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:04.277136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e064a-05f7-4337-b1ed-b86c6cd8b855 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:04.277490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e064a-05f7-4337-b1ed-b86c6cd8b855 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:04.294207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e064a-05f7-4337-b1ed-b86c6cd8b855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:04.302462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-bb5e064a-05f7-4337-b1ed-b86c6cd8b855 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:39:04.304085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 106/220] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:04.312590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e064a-05f7-4337-b1ed-b86c6cd8b855 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:04.345153 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8130-6d75-4b66-b82b-4fce09bb0a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:04.350159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8130-6d75-4b66-b82b-4fce09bb0a87 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:04.351065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8130-6d75-4b66-b82b-4fce09bb0a87 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:04.357559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8130-6d75-4b66-b82b-4fce09bb0a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:04.480655 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e064a-05f7-4337-b1ed-b86c6cd8b855 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:04.490625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8130-6d75-4b66-b82b-4fce09bb0a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:04.493932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8130-6d75-4b66-b82b-4fce09bb0a87 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:04.531353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649892a-bc44-49a8-b60f-7dd567fb6ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:04.532462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649892a-bc44-49a8-b60f-7dd567fb6ee8 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:04.532949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649892a-bc44-49a8-b60f-7dd567fb6ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:04.533431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649892a-bc44-49a8-b60f-7dd567fb6ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:04.534431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649892a-bc44-49a8-b60f-7dd567fb6ee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:04.534955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649892a-bc44-49a8-b60f-7dd567fb6ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:04.536596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649892a-bc44-49a8-b60f-7dd567fb6ee8 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:04.553978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 107/221] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:04.557779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649892a-bc44-49a8-b60f-7dd567fb6ee8 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:04.730097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 115/222] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:39:04.732147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8130-6d75-4b66-b82b-4fce09bb0a87 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:04.763157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649892a-bc44-49a8-b60f-7dd567fb6ee8 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:04.847567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094a3c7-bd7a-4604-9503-72fe382623f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:04.849387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094a3c7-bd7a-4604-9503-72fe382623f7 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:04.849851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094a3c7-bd7a-4604-9503-72fe382623f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:04.850344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094a3c7-bd7a-4604-9503-72fe382623f7 None admin] PATH_INFO: `/v3/users/74c5c3dbd1134718a124fdc3de154e1d` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:04.855037 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094a3c7-bd7a-4604-9503-72fe382623f7 None admin] RBAC: Authorizing `identity:get_user(user_id=74c5c3dbd1134718a124fdc3de154e1d)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:04.857616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094a3c7-bd7a-4604-9503-72fe382623f7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:04.860915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 108/223] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:04 2022] GET /identity/v3/users/74c5c3dbd1134718a124fdc3de154e1d => generated 283 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:04.871238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094a3c7-bd7a-4604-9503-72fe382623f7 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:05.007338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8130-6d75-4b66-b82b-4fce09bb0a87 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:05.117846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094a3c7-bd7a-4604-9503-72fe382623f7 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:05.129565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75e47d-4b98-4497-9279-cacd7afc516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:05.131470 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75e47d-4b98-4497-9279-cacd7afc516c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:05.132103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75e47d-4b98-4497-9279-cacd7afc516c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:05.132701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75e47d-4b98-4497-9279-cacd7afc516c None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:05.135184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75e47d-4b98-4497-9279-cacd7afc516c None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:05.138115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75e47d-4b98-4497-9279-cacd7afc516c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:05.145972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 116/224] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:04 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:05.173168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75e47d-4b98-4497-9279-cacd7afc516c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:05.193725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56399134-ee2f-4220-965f-856063c26656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:05.195578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399134-ee2f-4220-965f-856063c26656 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:05.196239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399134-ee2f-4220-965f-856063c26656 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:05.197024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399134-ee2f-4220-965f-856063c26656 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:05.199782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56399134-ee2f-4220-965f-856063c26656 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:05.203032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56399134-ee2f-4220-965f-856063c26656 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:05.206651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 109/225] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:04 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:05.220001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56399134-ee2f-4220-965f-856063c26656 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:05.386388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56399134-ee2f-4220-965f-856063c26656 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:05.422670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fb2b4-1b13-4f09-94c1-979daa093f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:05.423591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fb2b4-1b13-4f09-94c1-979daa093f34 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:05.423874 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fb2b4-1b13-4f09-94c1-979daa093f34 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:05.424150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fb2b4-1b13-4f09-94c1-979daa093f34 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8/users/74c5c3dbd1134718a124fdc3de154e1d/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:05.426442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fb2b4-1b13-4f09-94c1-979daa093f34 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d0172f0deac4b64babafdb092e05fd8, user_id=74c5c3dbd1134718a124fdc3de154e1d, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:05.427966 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fb2b4-1b13-4f09-94c1-979daa093f34 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:05.428504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75e47d-4b98-4497-9279-cacd7afc516c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:05.453975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 110/226] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:39:05 2022] PUT /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8/users/74c5c3dbd1134718a124fdc3de154e1d/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:39:05.453975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd32844-6c9b-44fa-9879-3377144d78c1 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:05.453975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd32844-6c9b-44fa-9879-3377144d78c1 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:05.453975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd32844-6c9b-44fa-9879-3377144d78c1 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:05.453975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 111/227] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:05.457910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0c90-4f3d-43c0-9fd8-f3fc10ae78f3 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:05.458465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0c90-4f3d-43c0-9fd8-f3fc10ae78f3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:05.459025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0c90-4f3d-43c0-9fd8-f3fc10ae78f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:05.489605 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-96bc0c90-4f3d-43c0-9fd8-f3fc10ae78f3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:05.491789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-96bc0c90-4f3d-43c0-9fd8-f3fc10ae78f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:05.538698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfb5a0-2030-4c65-9a6a-0e7d7b525c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:05.540214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfb5a0-2030-4c65-9a6a-0e7d7b525c18 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:05.541179 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfb5a0-2030-4c65-9a6a-0e7d7b525c18 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:05.542186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfb5a0-2030-4c65-9a6a-0e7d7b525c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:05.544004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfb5a0-2030-4c65-9a6a-0e7d7b525c18 None admin] RBAC: Adding query filter params (role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=2d0172f0deac4b64babafdb092e05fd8, user.id=1731c519890a41448304e6c96dbda95f) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:05.544792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfb5a0-2030-4c65-9a6a-0e7d7b525c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:05.553993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfb5a0-2030-4c65-9a6a-0e7d7b525c18 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:05.572581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 117/228] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:05 2022] GET /identity/v3/role_assignments?user.id=1731c519890a41448304e6c96dbda95f&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 259 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:05.622314 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 112/229] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:05.665928 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfb5a0-2030-4c65-9a6a-0e7d7b525c18 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:05.870403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfb5a0-2030-4c65-9a6a-0e7d7b525c18 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:05.951478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6b596-94ed-4cde-8f6d-ed8efdf5ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:05.953010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6b596-94ed-4cde-8f6d-ed8efdf5ec83 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:05.953502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6b596-94ed-4cde-8f6d-ed8efdf5ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:05.958033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6b596-94ed-4cde-8f6d-ed8efdf5ec83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:05.978757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6b596-94ed-4cde-8f6d-ed8efdf5ec83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:05.986369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a1a6b596-94ed-4cde-8f6d-ed8efdf5ec83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:39:05.988006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 118/230] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:39:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:05.994051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc0c90-4f3d-43c0-9fd8-f3fc10ae78f3 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:06.123330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc0c90-4f3d-43c0-9fd8-f3fc10ae78f3 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:06.159653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f4e5d-a061-441c-a164-8444df898352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:06.160346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f4e5d-a061-441c-a164-8444df898352 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:06.160628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f4e5d-a061-441c-a164-8444df898352 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:06.160907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f4e5d-a061-441c-a164-8444df898352 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:06.161670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f4e5d-a061-441c-a164-8444df898352 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:06.162002 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f4e5d-a061-441c-a164-8444df898352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:06.163419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f4e5d-a061-441c-a164-8444df898352 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:06.173248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 113/231] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:06.179094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6b596-94ed-4cde-8f6d-ed8efdf5ec83 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:06.307197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6b596-94ed-4cde-8f6d-ed8efdf5ec83 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:06.349883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe352-b174-480a-a95c-506f190b2788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:06.350824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe352-b174-480a-a95c-506f190b2788 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:06.351079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe352-b174-480a-a95c-506f190b2788 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:06.351413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe352-b174-480a-a95c-506f190b2788 None admin] PATH_INFO: `/v3/users/74c5c3dbd1134718a124fdc3de154e1d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:06.352600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fe352-b174-480a-a95c-506f190b2788 None admin] RBAC: Authorizing `identity:get_user(user_id=74c5c3dbd1134718a124fdc3de154e1d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:06.354466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fe352-b174-480a-a95c-506f190b2788 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:06.356480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 119/232] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:06 2022] GET /identity/v3/users/74c5c3dbd1134718a124fdc3de154e1d => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:06.362053 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f4e5d-a061-441c-a164-8444df898352 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:06.504034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f4e5d-a061-441c-a164-8444df898352 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:06.551059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204e38d-a45c-44b6-87d5-06b7e5535320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:06.551944 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204e38d-a45c-44b6-87d5-06b7e5535320 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:06.552240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204e38d-a45c-44b6-87d5-06b7e5535320 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:06.552485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204e38d-a45c-44b6-87d5-06b7e5535320 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:06.559028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204e38d-a45c-44b6-87d5-06b7e5535320 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:06.560433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204e38d-a45c-44b6-87d5-06b7e5535320 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:06.562621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 114/233] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:06 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:06.568443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe352-b174-480a-a95c-506f190b2788 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:06.686494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe352-b174-480a-a95c-506f190b2788 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:06.730009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2c89e-6edc-4f66-a137-684727b3ebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:06.730946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2c89e-6edc-4f66-a137-684727b3ebe4 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:06.731261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2c89e-6edc-4f66-a137-684727b3ebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:06.731498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2c89e-6edc-4f66-a137-684727b3ebe4 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8/users/74c5c3dbd1134718a124fdc3de154e1d/roles/3dae28c0ed754e34b0024bbb40d02fb7` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:06.733894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2c89e-6edc-4f66-a137-684727b3ebe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d0172f0deac4b64babafdb092e05fd8, user_id=74c5c3dbd1134718a124fdc3de154e1d, role_id=3dae28c0ed754e34b0024bbb40d02fb7)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:06.735413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2c89e-6edc-4f66-a137-684727b3ebe4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:06.757544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 120/234] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:39:06 2022] PUT /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8/users/74c5c3dbd1134718a124fdc3de154e1d/roles/3dae28c0ed754e34b0024bbb40d02fb7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:39:07.441195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518b78-3787-4225-908e-e1cedd0b3563 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:07.441953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518b78-3787-4225-908e-e1cedd0b3563 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:07.441953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518b78-3787-4225-908e-e1cedd0b3563 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:07.443910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 115/235] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:07.449917 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c91a8-f97e-4b43-bdca-8d6665de7007 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:07.450556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c91a8-f97e-4b43-bdca-8d6665de7007 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:07.450556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c91a8-f97e-4b43-bdca-8d6665de7007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:07.475205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-040c91a8-f97e-4b43-bdca-8d6665de7007 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:07.476450 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-040c91a8-f97e-4b43-bdca-8d6665de7007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:07.565817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 121/236] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:07.596205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76518b78-3787-4225-908e-e1cedd0b3563 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:07.763961 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76518b78-3787-4225-908e-e1cedd0b3563 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:07.848931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e278a-6001-496a-83d8-3834b12b8daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:07.850391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e278a-6001-496a-83d8-3834b12b8daa None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:07.850902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e278a-6001-496a-83d8-3834b12b8daa None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:07.851402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e278a-6001-496a-83d8-3834b12b8daa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:07.883653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e278a-6001-496a-83d8-3834b12b8daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:07.897773 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-9a3e278a-6001-496a-83d8-3834b12b8daa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 22 19:39:07.904614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 116/237] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:07.914031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c91a8-f97e-4b43-bdca-8d6665de7007 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:08.055906 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c91a8-f97e-4b43-bdca-8d6665de7007 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:08.101957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200f42d-436e-4483-b40f-ffcee15c784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:08.102657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200f42d-436e-4483-b40f-ffcee15c784c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.102977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200f42d-436e-4483-b40f-ffcee15c784c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.103286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200f42d-436e-4483-b40f-ffcee15c784c None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.104777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200f42d-436e-4483-b40f-ffcee15c784c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:08.105087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200f42d-436e-4483-b40f-ffcee15c784c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:08.106652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200f42d-436e-4483-b40f-ffcee15c784c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:08.116233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 122/238] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:08.123101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e278a-6001-496a-83d8-3834b12b8daa None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:08.152588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793178c5-2e21-44d4-8a1c-1c33de97a0e3 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.152898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793178c5-2e21-44d4-8a1c-1c33de97a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.153142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793178c5-2e21-44d4-8a1c-1c33de97a0e3 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.155331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 123/239] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:08.163161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb968c6-f11d-4c1c-8df5-1f6e7e1c7c59 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.163482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb968c6-f11d-4c1c-8df5-1f6e7e1c7c59 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.163712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb968c6-f11d-4c1c-8df5-1f6e7e1c7c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.193163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-afb968c6-f11d-4c1c-8df5-1f6e7e1c7c59 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:08.195243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-afb968c6-f11d-4c1c-8df5-1f6e7e1c7c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:08.282666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 124/240] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:08.312757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e278a-6001-496a-83d8-3834b12b8daa None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:08.332212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb968c6-f11d-4c1c-8df5-1f6e7e1c7c59 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:08.373270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8338ed4-cf56-462f-9584-c9ebd4d4c357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:08.375914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8338ed4-cf56-462f-9584-c9ebd4d4c357 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.375914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8338ed4-cf56-462f-9584-c9ebd4d4c357 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.375914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8338ed4-cf56-462f-9584-c9ebd4d4c357 None admin] PATH_INFO: `/v3/users/d709328f7de64437ac1ccb237e2228e2` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.393410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8338ed4-cf56-462f-9584-c9ebd4d4c357 None admin] RBAC: Authorizing `identity:get_user(user_id=d709328f7de64437ac1ccb237e2228e2)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:08.395696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8338ed4-cf56-462f-9584-c9ebd4d4c357 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:08.398058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 117/241] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:08 2022] GET /identity/v3/users/d709328f7de64437ac1ccb237e2228e2 => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:08.404816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8338ed4-cf56-462f-9584-c9ebd4d4c357 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:08.532511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8338ed4-cf56-462f-9584-c9ebd4d4c357 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:08.578481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca486d-7e45-4b5d-9c90-0b0f5ea9b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:08.579088 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca486d-7e45-4b5d-9c90-0b0f5ea9b9a3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.579369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca486d-7e45-4b5d-9c90-0b0f5ea9b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.579638 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca486d-7e45-4b5d-9c90-0b0f5ea9b9a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.662949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca486d-7e45-4b5d-9c90-0b0f5ea9b9a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:08.664449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca486d-7e45-4b5d-9c90-0b0f5ea9b9a3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:08.677303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb968c6-f11d-4c1c-8df5-1f6e7e1c7c59 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:08.788458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 118/242] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:08.796957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca486d-7e45-4b5d-9c90-0b0f5ea9b9a3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:08.802363 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbe0e5-18e0-4e2f-aa32-e42a28ed26ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:08.808147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbe0e5-18e0-4e2f-aa32-e42a28ed26ec None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.808677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbe0e5-18e0-4e2f-aa32-e42a28ed26ec None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.809097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbe0e5-18e0-4e2f-aa32-e42a28ed26ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.810690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbe0e5-18e0-4e2f-aa32-e42a28ed26ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:08.812327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbe0e5-18e0-4e2f-aa32-e42a28ed26ec None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:08.815983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 125/243] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:08.822463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbe0e5-18e0-4e2f-aa32-e42a28ed26ec None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:08.926266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca486d-7e45-4b5d-9c90-0b0f5ea9b9a3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:08.942873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbe0e5-18e0-4e2f-aa32-e42a28ed26ec None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:08.966747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea313a7-678c-4523-bc51-6fc367f42ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:08.967927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea313a7-678c-4523-bc51-6fc367f42ed3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.968216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea313a7-678c-4523-bc51-6fc367f42ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.968491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea313a7-678c-4523-bc51-6fc367f42ed3 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.970265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea313a7-678c-4523-bc51-6fc367f42ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:08.972242 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea313a7-678c-4523-bc51-6fc367f42ed3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:08.980476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 119/244] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:08 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:08.980476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5dbe8-6d43-4259-a891-581ec5634557 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.980476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5dbe8-6d43-4259-a891-581ec5634557 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.980476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5dbe8-6d43-4259-a891-581ec5634557 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.981450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 120/245] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:08.981748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1f4b6-64a3-4c00-bd62-3c319f506bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:08.982483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f4b6-64a3-4c00-bd62-3c319f506bb6 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.982759 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f4b6-64a3-4c00-bd62-3c319f506bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.983030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f4b6-64a3-4c00-bd62-3c319f506bb6 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.983770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1f4b6-64a3-4c00-bd62-3c319f506bb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:08.984229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f514-77a7-4cc4-b02a-b68cd4cfbdb1 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:08.984703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f514-77a7-4cc4-b02a-b68cd4cfbdb1 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:08.985232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1f4b6-64a3-4c00-bd62-3c319f506bb6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:08.985365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5f514-77a7-4cc4-b02a-b68cd4cfbdb1 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:08.987204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 121/246] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:08.987823 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f514-77a7-4cc4-b02a-b68cd4cfbdb1 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:09.017797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 126/247] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:39:08 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:39:09.017797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bbb26-28be-4bd1-bddb-ac5e62bfd4e2 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:09.017797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bbb26-28be-4bd1-bddb-ac5e62bfd4e2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:09.017797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bbb26-28be-4bd1-bddb-ac5e62bfd4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:09.036526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-ac4bbb26-28be-4bd1-bddb-ac5e62bfd4e2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:09.037782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ac4bbb26-28be-4bd1-bddb-ac5e62bfd4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:09.132371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5f514-77a7-4cc4-b02a-b68cd4cfbdb1 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:09.133184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 127/248] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:09.134613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb478348-2eff-4185-9318-ef2dfed831bb None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:09.134909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb478348-2eff-4185-9318-ef2dfed831bb None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:09.135185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb478348-2eff-4185-9318-ef2dfed831bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:09.153429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-bb478348-2eff-4185-9318-ef2dfed831bb None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:09.154707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-bb478348-2eff-4185-9318-ef2dfed831bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:09.174855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914fd4-2c02-4143-b219-148215590847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:09.175576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914fd4-2c02-4143-b219-148215590847 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:09.175901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914fd4-2c02-4143-b219-148215590847 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:09.176224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914fd4-2c02-4143-b219-148215590847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:09.177154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76914fd4-2c02-4143-b219-148215590847 None admin] RBAC: Adding query filter params (role.id=8970adb53a594bf68973ee9679c03bcd, scope.project.id=2d0172f0deac4b64babafdb092e05fd8, user.id=d709328f7de64437ac1ccb237e2228e2) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:09.177500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76914fd4-2c02-4143-b219-148215590847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:09.179359 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76914fd4-2c02-4143-b219-148215590847 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:09.186717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 122/249] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:08 2022] GET /identity/v3/role_assignments?user.id=d709328f7de64437ac1ccb237e2228e2&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=8970adb53a594bf68973ee9679c03bcd => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:09.187604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914fd4-2c02-4143-b219-148215590847 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:09.266474 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 128/250] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:09.292569 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb478348-2eff-4185-9318-ef2dfed831bb None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:09.365329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914fd4-2c02-4143-b219-148215590847 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:09.438017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408e83-7f7c-401e-a13f-025d96fcfbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:09.439194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408e83-7f7c-401e-a13f-025d96fcfbe4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:09.439689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408e83-7f7c-401e-a13f-025d96fcfbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:09.440185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408e83-7f7c-401e-a13f-025d96fcfbe4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:09.460620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f408e83-7f7c-401e-a13f-025d96fcfbe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:09.468575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-7f408e83-7f7c-401e-a13f-025d96fcfbe4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:09.475881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb478348-2eff-4185-9318-ef2dfed831bb None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:09.476560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 123/251] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:09.480097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408e83-7f7c-401e-a13f-025d96fcfbe4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:09.517867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65bcd8-2b7b-4ee9-a10b-ddc52d1afdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:09.518763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65bcd8-2b7b-4ee9-a10b-ddc52d1afdca None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:09.519469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65bcd8-2b7b-4ee9-a10b-ddc52d1afdca None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:09.519754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65bcd8-2b7b-4ee9-a10b-ddc52d1afdca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:09.536142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65bcd8-2b7b-4ee9-a10b-ddc52d1afdca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:09.545500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-8f65bcd8-2b7b-4ee9-a10b-ddc52d1afdca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:39:09.547149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 129/252] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:09.554211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65bcd8-2b7b-4ee9-a10b-ddc52d1afdca None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:09.611472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408e83-7f7c-401e-a13f-025d96fcfbe4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:09.648285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491abc3-d6dd-434e-9097-cb20583c92dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:09.649122 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491abc3-d6dd-434e-9097-cb20583c92dd None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:09.649620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491abc3-d6dd-434e-9097-cb20583c92dd None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:09.650189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491abc3-d6dd-434e-9097-cb20583c92dd None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:09.651190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491abc3-d6dd-434e-9097-cb20583c92dd None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:09.651722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491abc3-d6dd-434e-9097-cb20583c92dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:09.653375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491abc3-d6dd-434e-9097-cb20583c92dd None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:09.667906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 124/253] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:09.669642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65bcd8-2b7b-4ee9-a10b-ddc52d1afdca None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:09.669801 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491abc3-d6dd-434e-9097-cb20583c92dd None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:09.707633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2867b8-7748-463a-aa20-cf005af34c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:09.708923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2867b8-7748-463a-aa20-cf005af34c1f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:09.709350 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2867b8-7748-463a-aa20-cf005af34c1f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:09.709777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2867b8-7748-463a-aa20-cf005af34c1f None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:09.710759 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2867b8-7748-463a-aa20-cf005af34c1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:09.711236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2867b8-7748-463a-aa20-cf005af34c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:09.713168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2867b8-7748-463a-aa20-cf005af34c1f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:09.724105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 130/254] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:09.730956 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2867b8-7748-463a-aa20-cf005af34c1f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:09.783179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491abc3-d6dd-434e-9097-cb20583c92dd None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:09.818462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10bd7c-cf2b-4607-99ab-219e29230f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:09.819836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10bd7c-cf2b-4607-99ab-219e29230f6e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:09.820337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10bd7c-cf2b-4607-99ab-219e29230f6e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:09.820820 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10bd7c-cf2b-4607-99ab-219e29230f6e None admin] PATH_INFO: `/v3/users/1731c519890a41448304e6c96dbda95f` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:09.822466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10bd7c-cf2b-4607-99ab-219e29230f6e None admin] RBAC: Authorizing `identity:get_user(user_id=1731c519890a41448304e6c96dbda95f)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:09.824199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10bd7c-cf2b-4607-99ab-219e29230f6e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:09.826172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 125/255] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:09 2022] GET /identity/v3/users/1731c519890a41448304e6c96dbda95f => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:09.832669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10bd7c-cf2b-4607-99ab-219e29230f6e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:09.841152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2867b8-7748-463a-aa20-cf005af34c1f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:09.881627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f9e2e-9d0e-4367-ae45-2d95a408ca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:09.883122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9e2e-9d0e-4367-ae45-2d95a408ca69 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:09.883649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9e2e-9d0e-4367-ae45-2d95a408ca69 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:09.884510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9e2e-9d0e-4367-ae45-2d95a408ca69 None admin] PATH_INFO: `/v3/users/74c5c3dbd1134718a124fdc3de154e1d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:09.886854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f9e2e-9d0e-4367-ae45-2d95a408ca69 None admin] RBAC: Authorizing `identity:get_user(user_id=74c5c3dbd1134718a124fdc3de154e1d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:09.889875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f9e2e-9d0e-4367-ae45-2d95a408ca69 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:09.893422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 131/256] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:09 2022] GET /identity/v3/users/74c5c3dbd1134718a124fdc3de154e1d => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:09.903396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f9e2e-9d0e-4367-ae45-2d95a408ca69 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:10.004925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10bd7c-cf2b-4607-99ab-219e29230f6e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:10.062754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ce6cf-46fb-41be-b24b-b2fe8d980233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:10.064368 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ce6cf-46fb-41be-b24b-b2fe8d980233 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:10.064946 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ce6cf-46fb-41be-b24b-b2fe8d980233 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:10.065516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ce6cf-46fb-41be-b24b-b2fe8d980233 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:10.067789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ce6cf-46fb-41be-b24b-b2fe8d980233 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:10.071084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ce6cf-46fb-41be-b24b-b2fe8d980233 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:10.082009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 126/257] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:09 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:10.083470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ce6cf-46fb-41be-b24b-b2fe8d980233 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:10.100621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f9e2e-9d0e-4367-ae45-2d95a408ca69 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:10.196329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7e1a5-2a7d-498c-9376-41d06ced6658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:10.197264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7e1a5-2a7d-498c-9376-41d06ced6658 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:10.197611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7e1a5-2a7d-498c-9376-41d06ced6658 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:10.197929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7e1a5-2a7d-498c-9376-41d06ced6658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:10.267046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ce6cf-46fb-41be-b24b-b2fe8d980233 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:10.334303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feb66d-11c7-4f7b-9322-7f1673dea884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:10.334303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb66d-11c7-4f7b-9322-7f1673dea884 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:10.334303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb66d-11c7-4f7b-9322-7f1673dea884 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:10.334303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb66d-11c7-4f7b-9322-7f1673dea884 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8/users/1731c519890a41448304e6c96dbda95f/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:10.335510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feb66d-11c7-4f7b-9322-7f1673dea884 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d0172f0deac4b64babafdb092e05fd8, user_id=1731c519890a41448304e6c96dbda95f, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:10.338412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feb66d-11c7-4f7b-9322-7f1673dea884 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:10.376033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7e1a5-2a7d-498c-9376-41d06ced6658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:10.379219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7e1a5-2a7d-498c-9376-41d06ced6658 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:10.379931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 127/258] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:39:10 2022] PUT /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8/users/1731c519890a41448304e6c96dbda95f/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:39:10.498611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def9fe-095c-4f53-ba6b-0fdc4b50c25e None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:10.499021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def9fe-095c-4f53-ba6b-0fdc4b50c25e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:10.499155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def9fe-095c-4f53-ba6b-0fdc4b50c25e None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:10.501070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 128/259] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:10.507130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f83f1-12d4-4640-b9ad-e82bbb4bf1cd None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:10.507766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f83f1-12d4-4640-b9ad-e82bbb4bf1cd None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:10.508257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f83f1-12d4-4640-b9ad-e82bbb4bf1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:10.551261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-805f83f1-12d4-4640-b9ad-e82bbb4bf1cd None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:10.552826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-805f83f1-12d4-4640-b9ad-e82bbb4bf1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:10.567441 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 132/260] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:39:10.576923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7e1a5-2a7d-498c-9376-41d06ced6658 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:10.754065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 129/261] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:10.818567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f83f1-12d4-4640-b9ad-e82bbb4bf1cd None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:10.868703 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7e1a5-2a7d-498c-9376-41d06ced6658 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:10.982559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae693-a94e-4bd8-b470-236b6d4c9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:10.983975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae693-a94e-4bd8-b470-236b6d4c9dbb None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:10.984425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae693-a94e-4bd8-b470-236b6d4c9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:10.984885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae693-a94e-4bd8-b470-236b6d4c9dbb None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:10.987210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ae693-a94e-4bd8-b470-236b6d4c9dbb None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:10.989815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ae693-a94e-4bd8-b470-236b6d4c9dbb None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:10.993400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 133/262] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:10 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:11.028243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae693-a94e-4bd8-b470-236b6d4c9dbb None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:11.078826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f83f1-12d4-4640-b9ad-e82bbb4bf1cd None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:11.137924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb1e2-7777-449a-be32-132dbf1c7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:11.139286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb1e2-7777-449a-be32-132dbf1c7263 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:11.139741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb1e2-7777-449a-be32-132dbf1c7263 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:11.140181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb1e2-7777-449a-be32-132dbf1c7263 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:11.158658 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbb1e2-7777-449a-be32-132dbf1c7263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:11.172949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-7ecbb1e2-7777-449a-be32-132dbf1c7263 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:39:11.175245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 130/263] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:39:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:11.184857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb1e2-7777-449a-be32-132dbf1c7263 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:11.315136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae693-a94e-4bd8-b470-236b6d4c9dbb None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:11.391471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb1e2-7777-449a-be32-132dbf1c7263 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:11.442262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c20cf-be5e-40f6-b7cd-efad68a64380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:11.443316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c20cf-be5e-40f6-b7cd-efad68a64380 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:11.443763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c20cf-be5e-40f6-b7cd-efad68a64380 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:11.444216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c20cf-be5e-40f6-b7cd-efad68a64380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:11.445680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c20cf-be5e-40f6-b7cd-efad68a64380 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=2d0172f0deac4b64babafdb092e05fd8, user.id=74c5c3dbd1134718a124fdc3de154e1d) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:11.446236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c20cf-be5e-40f6-b7cd-efad68a64380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:11.448978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c20cf-be5e-40f6-b7cd-efad68a64380 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:11.465719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de8fd-b11d-48a1-b8a5-de8e9b74b281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:11.466903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de8fd-b11d-48a1-b8a5-de8e9b74b281 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:11.467395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de8fd-b11d-48a1-b8a5-de8e9b74b281 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:11.467876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de8fd-b11d-48a1-b8a5-de8e9b74b281 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:11.473087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591de8fd-b11d-48a1-b8a5-de8e9b74b281 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:11.474327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591de8fd-b11d-48a1-b8a5-de8e9b74b281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:11.476912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591de8fd-b11d-48a1-b8a5-de8e9b74b281 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:11.486099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 134/264] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:11 2022] GET /identity/v3/role_assignments?user.id=74c5c3dbd1134718a124fdc3de154e1d&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 608 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:11.507278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 131/265] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:11.517200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c20cf-be5e-40f6-b7cd-efad68a64380 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:11.731470 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c20cf-be5e-40f6-b7cd-efad68a64380 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:11.815438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86014b7-9fe1-4872-8483-2f3aed40224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:11.817301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86014b7-9fe1-4872-8483-2f3aed40224b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:11.817792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86014b7-9fe1-4872-8483-2f3aed40224b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:11.818328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86014b7-9fe1-4872-8483-2f3aed40224b None admin] PATH_INFO: `/v3/users/74c5c3dbd1134718a124fdc3de154e1d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:11.820854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86014b7-9fe1-4872-8483-2f3aed40224b None admin] RBAC: Authorizing `identity:get_user(user_id=74c5c3dbd1134718a124fdc3de154e1d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:11.823655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86014b7-9fe1-4872-8483-2f3aed40224b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:11.826963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 135/266] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:11 2022] GET /identity/v3/users/74c5c3dbd1134718a124fdc3de154e1d => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:11.850475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de8fd-b11d-48a1-b8a5-de8e9b74b281 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:12.108286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de8fd-b11d-48a1-b8a5-de8e9b74b281 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:12.155567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f8474-4356-48bb-9404-9591a41c33b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:12.156236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8474-4356-48bb-9404-9591a41c33b5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:12.156508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8474-4356-48bb-9404-9591a41c33b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:12.156774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8474-4356-48bb-9404-9591a41c33b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:12.237771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f8474-4356-48bb-9404-9591a41c33b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:12.239286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f8474-4356-48bb-9404-9591a41c33b5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:12.407413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 132/267] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:39:12.413464 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86014b7-9fe1-4872-8483-2f3aed40224b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:12.596802 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86014b7-9fe1-4872-8483-2f3aed40224b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:12.642342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3ba12-6db4-48db-b9b1-f9cfe6526a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:12.643535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ba12-6db4-48db-b9b1-f9cfe6526a83 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:12.643986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ba12-6db4-48db-b9b1-f9cfe6526a83 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:12.644462 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3ba12-6db4-48db-b9b1-f9cfe6526a83 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:12.647294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3ba12-6db4-48db-b9b1-f9cfe6526a83 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:12.650019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3ba12-6db4-48db-b9b1-f9cfe6526a83 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:12.653826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 136/268] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:12 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:12.659536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f8474-4356-48bb-9404-9591a41c33b5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:12.858238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f8474-4356-48bb-9404-9591a41c33b5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:12.924889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c007fe3-1ada-4f0d-bc59-0e937c316fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:12.925952 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c007fe3-1ada-4f0d-bc59-0e937c316fa2 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:12.926457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c007fe3-1ada-4f0d-bc59-0e937c316fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:12.927004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c007fe3-1ada-4f0d-bc59-0e937c316fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:12.928613 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c007fe3-1ada-4f0d-bc59-0e937c316fa2 None admin] RBAC: Adding query filter params (role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=2d0172f0deac4b64babafdb092e05fd8, user.id=74c5c3dbd1134718a124fdc3de154e1d) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:12.929126 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c007fe3-1ada-4f0d-bc59-0e937c316fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:12.932402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c007fe3-1ada-4f0d-bc59-0e937c316fa2 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:12.942986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 133/269] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:12 2022] GET /identity/v3/role_assignments?user.id=74c5c3dbd1134718a124fdc3de154e1d&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:13.566067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb877-2628-4f4c-9b09-5da171fbc345 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:13.566067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb877-2628-4f4c-9b09-5da171fbc345 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:13.566067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb877-2628-4f4c-9b09-5da171fbc345 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:13.567123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 137/270] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:13.574688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b9e6e-b9cb-403b-8e35-3f6300b4b97c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:13.575285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b9e6e-b9cb-403b-8e35-3f6300b4b97c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:13.575766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b9e6e-b9cb-403b-8e35-3f6300b4b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:13.595132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a52b9e6e-b9cb-403b-8e35-3f6300b4b97c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:13.596732 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a52b9e6e-b9cb-403b-8e35-3f6300b4b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:13.682553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 134/271] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:13.704240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb877-2628-4f4c-9b09-5da171fbc345 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:13.719967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725743c-4966-47bf-b1c9-4b39089f7893 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:13.721059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725743c-4966-47bf-b1c9-4b39089f7893 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:13.721611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725743c-4966-47bf-b1c9-4b39089f7893 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:13.724540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 135/272] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:13.730935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f5a3-96b4-4dfc-ab7d-bae968735e0c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:13.731260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f5a3-96b4-4dfc-ab7d-bae968735e0c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:13.731502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f5a3-96b4-4dfc-ab7d-bae968735e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:13.754033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-3f44f5a3-96b4-4dfc-ab7d-bae968735e0c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:13.755525 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3f44f5a3-96b4-4dfc-ab7d-bae968735e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:13.841689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 136/273] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:13.864659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb877-2628-4f4c-9b09-5da171fbc345 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:13.869900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44f5a3-96b4-4dfc-ab7d-bae968735e0c None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:13.907687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbe00b-a06c-4522-9619-17e55f7eb26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:13.908886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbe00b-a06c-4522-9619-17e55f7eb26e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:13.909345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbe00b-a06c-4522-9619-17e55f7eb26e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:13.909866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbe00b-a06c-4522-9619-17e55f7eb26e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:13.922189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbe00b-a06c-4522-9619-17e55f7eb26e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:13.929842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-8acbe00b-a06c-4522-9619-17e55f7eb26e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 22 19:39:13.931487 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 138/274] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:13.938387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbe00b-a06c-4522-9619-17e55f7eb26e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:13.995340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44f5a3-96b4-4dfc-ab7d-bae968735e0c None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.039914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fad04d-aef9-44b1-8eb2-c5f76678ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.041529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad04d-aef9-44b1-8eb2-c5f76678ce36 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.041817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad04d-aef9-44b1-8eb2-c5f76678ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.042121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad04d-aef9-44b1-8eb2-c5f76678ce36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.057763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fad04d-aef9-44b1-8eb2-c5f76678ce36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:14.064798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-86fad04d-aef9-44b1-8eb2-c5f76678ce36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:14.066104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 137/275] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:14.067371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245628-01ef-4155-bf86-7166782b8fdc None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.067648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245628-01ef-4155-bf86-7166782b8fdc None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.067920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245628-01ef-4155-bf86-7166782b8fdc None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.069998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 138/276] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:14.071204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1c3f-0986-492d-a282-733e7571fccf None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.071556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1c3f-0986-492d-a282-733e7571fccf None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.071830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1c3f-0986-492d-a282-733e7571fccf None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.073679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 139/277] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:14.075788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1c3f-0986-492d-a282-733e7571fccf None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.089857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbe00b-a06c-4522-9619-17e55f7eb26e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.129268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd4043-fbd4-478d-bdea-c42c4bb8a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.129848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd4043-fbd4-478d-bdea-c42c4bb8a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.130152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd4043-fbd4-478d-bdea-c42c4bb8a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.130422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd4043-fbd4-478d-bdea-c42c4bb8a9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.131175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd4043-fbd4-478d-bdea-c42c4bb8a9c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:14.131480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd4043-fbd4-478d-bdea-c42c4bb8a9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:14.132920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd4043-fbd4-478d-bdea-c42c4bb8a9c8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:14.142223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 139/278] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:14.143341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e287539-a5df-4b48-b1ce-4fa6cfe25ed4 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.143621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e287539-a5df-4b48-b1ce-4fa6cfe25ed4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.143890 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e287539-a5df-4b48-b1ce-4fa6cfe25ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.162111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8e287539-a5df-4b48-b1ce-4fa6cfe25ed4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:14.163280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8e287539-a5df-4b48-b1ce-4fa6cfe25ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:14.192736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1c3f-0986-492d-a282-733e7571fccf None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.230429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dfcea-e644-4b13-aecf-1fca0c65d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.231124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dfcea-e644-4b13-aecf-1fca0c65d0bd None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.231400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dfcea-e644-4b13-aecf-1fca0c65d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.231669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dfcea-e644-4b13-aecf-1fca0c65d0bd None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.232422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dfcea-e644-4b13-aecf-1fca0c65d0bd None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:14.232727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dfcea-e644-4b13-aecf-1fca0c65d0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:14.234204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dfcea-e644-4b13-aecf-1fca0c65d0bd None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:14.238767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 140/279] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:14.240093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636fec-c079-489e-b1d9-7e3ca74531a8 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.240377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636fec-c079-489e-b1d9-7e3ca74531a8 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.240659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636fec-c079-489e-b1d9-7e3ca74531a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.243199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 140/280] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:14.244077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dfcea-e644-4b13-aecf-1fca0c65d0bd None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.267328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-fb636fec-c079-489e-b1d9-7e3ca74531a8 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:14.268542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-fb636fec-c079-489e-b1d9-7e3ca74531a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:14.347943 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 141/281] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:14.349257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636fec-c079-489e-b1d9-7e3ca74531a8 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.374604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dfcea-e644-4b13-aecf-1fca0c65d0bd None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.413417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e868d-7946-48c7-8cd9-2450dc3605c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.414233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e868d-7946-48c7-8cd9-2450dc3605c7 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.414516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e868d-7946-48c7-8cd9-2450dc3605c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.414787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e868d-7946-48c7-8cd9-2450dc3605c7 None admin] PATH_INFO: `/v3/users/d709328f7de64437ac1ccb237e2228e2` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.416686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e868d-7946-48c7-8cd9-2450dc3605c7 None admin] RBAC: Authorizing `identity:get_user(user_id=d709328f7de64437ac1ccb237e2228e2)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:14.427696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e868d-7946-48c7-8cd9-2450dc3605c7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:14.427696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 141/282] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:14 2022] GET /identity/v3/users/d709328f7de64437ac1ccb237e2228e2 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:14.427696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e868d-7946-48c7-8cd9-2450dc3605c7 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.498818 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636fec-c079-489e-b1d9-7e3ca74531a8 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.536585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa91eb-c554-414c-b2fd-09a7d1fb50f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.537458 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa91eb-c554-414c-b2fd-09a7d1fb50f5 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.537738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa91eb-c554-414c-b2fd-09a7d1fb50f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.538066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa91eb-c554-414c-b2fd-09a7d1fb50f5 None admin] PATH_INFO: `/v3/users/d95ea2386b7b4973ba99c54e2ba81f2e` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.550619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e868d-7946-48c7-8cd9-2450dc3605c7 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.555472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa91eb-c554-414c-b2fd-09a7d1fb50f5 None admin] RBAC: Authorizing `identity:get_user(user_id=d95ea2386b7b4973ba99c54e2ba81f2e)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:14.557152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa91eb-c554-414c-b2fd-09a7d1fb50f5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:14.558953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 142/283] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:14 2022] GET /identity/v3/users/d95ea2386b7b4973ba99c54e2ba81f2e => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:14.559739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa91eb-c554-414c-b2fd-09a7d1fb50f5 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.592117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d5f95-8222-4d15-b8fd-f8c36c70292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.592917 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d5f95-8222-4d15-b8fd-f8c36c70292f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.593383 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d5f95-8222-4d15-b8fd-f8c36c70292f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.593506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d5f95-8222-4d15-b8fd-f8c36c70292f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.606725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d5f95-8222-4d15-b8fd-f8c36c70292f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:14.613625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a84d5f95-8222-4d15-b8fd-f8c36c70292f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:14.615070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 142/284] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:14.615749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d5f95-8222-4d15-b8fd-f8c36c70292f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.661231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa91eb-c554-414c-b2fd-09a7d1fb50f5 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.695487 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bfba3-be27-4547-b1a7-8f8e87a07954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.697142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bfba3-be27-4547-b1a7-8f8e87a07954 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.697789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bfba3-be27-4547-b1a7-8f8e87a07954 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.698141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bfba3-be27-4547-b1a7-8f8e87a07954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.699758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bfba3-be27-4547-b1a7-8f8e87a07954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:14.702315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bfba3-be27-4547-b1a7-8f8e87a07954 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:14.704273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 143/285] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:14.705056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bfba3-be27-4547-b1a7-8f8e87a07954 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.724502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d5f95-8222-4d15-b8fd-f8c36c70292f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.761632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b56cc-dbfd-4bea-a4cd-18f49db010b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.762536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b56cc-dbfd-4bea-a4cd-18f49db010b0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.762809 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b56cc-dbfd-4bea-a4cd-18f49db010b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.763075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b56cc-dbfd-4bea-a4cd-18f49db010b0 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.764298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b56cc-dbfd-4bea-a4cd-18f49db010b0 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:14.765759 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b56cc-dbfd-4bea-a4cd-18f49db010b0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:14.767658 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 143/286] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:14 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:14.768330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b56cc-dbfd-4bea-a4cd-18f49db010b0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.812282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bfba3-be27-4547-b1a7-8f8e87a07954 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.849970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3f3bb-8ebf-42eb-be63-6b0bf8ba926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.850667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f3bb-8ebf-42eb-be63-6b0bf8ba926c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.850949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f3bb-8ebf-42eb-be63-6b0bf8ba926c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.851359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3f3bb-8ebf-42eb-be63-6b0bf8ba926c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.852064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3f3bb-8ebf-42eb-be63-6b0bf8ba926c None admin] RBAC: Adding query filter params (role.id=a50cc38d78674f6eaffc44a0a26ed453, user.id=d95ea2386b7b4973ba99c54e2ba81f2e, scope.system=all) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:14.852378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3f3bb-8ebf-42eb-be63-6b0bf8ba926c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:14.854230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3f3bb-8ebf-42eb-be63-6b0bf8ba926c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:14.859778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 144/287] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Mar 22 19:39:14 2022] GET /identity/v3/role_assignments?user.id=d95ea2386b7b4973ba99c54e2ba81f2e&scope.system=all&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:14.860583 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3f3bb-8ebf-42eb-be63-6b0bf8ba926c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.878534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b56cc-dbfd-4bea-a4cd-18f49db010b0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:14.941118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d38e8e-532c-4701-b945-c6fe329b658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:14.942286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d38e8e-532c-4701-b945-c6fe329b658e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:14.942796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d38e8e-532c-4701-b945-c6fe329b658e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:14.943260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d38e8e-532c-4701-b945-c6fe329b658e None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:14.944260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d38e8e-532c-4701-b945-c6fe329b658e None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:14.944677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d38e8e-532c-4701-b945-c6fe329b658e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:14.946239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d38e8e-532c-4701-b945-c6fe329b658e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:14.956579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 144/288] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:14.957446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d38e8e-532c-4701-b945-c6fe329b658e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:14.989355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3f3bb-8ebf-42eb-be63-6b0bf8ba926c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:15.030720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c0068-a821-4493-ad40-06857dcd3427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:15.031415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0068-a821-4493-ad40-06857dcd3427 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:15.031688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0068-a821-4493-ad40-06857dcd3427 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:15.032107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0068-a821-4493-ad40-06857dcd3427 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:15.032689 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c0068-a821-4493-ad40-06857dcd3427 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:15.034230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c0068-a821-4493-ad40-06857dcd3427 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:15.059735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 145/289] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:39:14 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:39:15.060492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c0068-a821-4493-ad40-06857dcd3427 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:15.108900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d38e8e-532c-4701-b945-c6fe329b658e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:15.148749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992267f-4c16-479e-bf4b-bb906c171bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:15.149717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992267f-4c16-479e-bf4b-bb906c171bc9 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:15.150047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992267f-4c16-479e-bf4b-bb906c171bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:15.150344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992267f-4c16-479e-bf4b-bb906c171bc9 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8/users/d709328f7de64437ac1ccb237e2228e2/roles/8970adb53a594bf68973ee9679c03bcd` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:15.152555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992267f-4c16-479e-bf4b-bb906c171bc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d0172f0deac4b64babafdb092e05fd8, user_id=d709328f7de64437ac1ccb237e2228e2, role_id=8970adb53a594bf68973ee9679c03bcd)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:15.154091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992267f-4c16-479e-bf4b-bb906c171bc9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:15.172840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 145/290] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:39:14 2022] PUT /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8/users/d709328f7de64437ac1ccb237e2228e2/roles/8970adb53a594bf68973ee9679c03bcd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:39:15.180320 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c0068-a821-4493-ad40-06857dcd3427 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:15.224489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4928d-dfae-4227-8e62-5545a79e4223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:15.225317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4928d-dfae-4227-8e62-5545a79e4223 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:15.225587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4928d-dfae-4227-8e62-5545a79e4223 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:15.225856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4928d-dfae-4227-8e62-5545a79e4223 None admin] PATH_INFO: `/v3/users/1731c519890a41448304e6c96dbda95f` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:15.227313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4928d-dfae-4227-8e62-5545a79e4223 None admin] RBAC: Authorizing `identity:get_user(user_id=1731c519890a41448304e6c96dbda95f)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:15.229369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4928d-dfae-4227-8e62-5545a79e4223 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:15.231414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 146/291] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:15 2022] GET /identity/v3/users/1731c519890a41448304e6c96dbda95f => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:15.237659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992267f-4c16-479e-bf4b-bb906c171bc9 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:15.382265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992267f-4c16-479e-bf4b-bb906c171bc9 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:15.423084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a009b2-beaa-40ea-b954-adff5802af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:15.423766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a009b2-beaa-40ea-b954-adff5802af4c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:15.424040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a009b2-beaa-40ea-b954-adff5802af4c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:15.424312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a009b2-beaa-40ea-b954-adff5802af4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:15.508700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a009b2-beaa-40ea-b954-adff5802af4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:15.510679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a009b2-beaa-40ea-b954-adff5802af4c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:15.630085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 146/292] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:15.642209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4928d-dfae-4227-8e62-5545a79e4223 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:15.829885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4928d-dfae-4227-8e62-5545a79e4223 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:15.893418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426387b5-4071-461a-8f9a-fe5ce1b2315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:15.894736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426387b5-4071-461a-8f9a-fe5ce1b2315d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:15.895214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426387b5-4071-461a-8f9a-fe5ce1b2315d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:15.895701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426387b5-4071-461a-8f9a-fe5ce1b2315d None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:15.897111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426387b5-4071-461a-8f9a-fe5ce1b2315d None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:15.898794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426387b5-4071-461a-8f9a-fe5ce1b2315d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:15.901321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 147/293] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:15 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:15.910253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a009b2-beaa-40ea-b954-adff5802af4c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:16.030903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a009b2-beaa-40ea-b954-adff5802af4c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:16.074945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8de8f-bec3-4229-af3c-3d0fbfe2cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:16.076003 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8de8f-bec3-4229-af3c-3d0fbfe2cb7d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:16.076473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8de8f-bec3-4229-af3c-3d0fbfe2cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:16.076928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8de8f-bec3-4229-af3c-3d0fbfe2cb7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:16.078002 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8de8f-bec3-4229-af3c-3d0fbfe2cb7d None admin] RBAC: Adding query filter params (role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=2d0172f0deac4b64babafdb092e05fd8, user.id=1731c519890a41448304e6c96dbda95f) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:16.078506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8de8f-bec3-4229-af3c-3d0fbfe2cb7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:16.080220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8de8f-bec3-4229-af3c-3d0fbfe2cb7d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:16.091542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 147/294] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:15 2022] GET /identity/v3/role_assignments?user.id=1731c519890a41448304e6c96dbda95f&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:17.942094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5827e9-64d1-43f5-9001-e00cae9ea8db None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:17.943122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5827e9-64d1-43f5-9001-e00cae9ea8db None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:17.943622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5827e9-64d1-43f5-9001-e00cae9ea8db None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:17.945904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 148/295] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:17.956188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f109b-7906-4811-818e-11b476add6ef None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:17.957175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f109b-7906-4811-818e-11b476add6ef None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:17.957641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f109b-7906-4811-818e-11b476add6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:17.977206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a91f109b-7906-4811-818e-11b476add6ef None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:17.979375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a91f109b-7906-4811-818e-11b476add6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:18.074469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 148/296] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:18.099096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5827e9-64d1-43f5-9001-e00cae9ea8db None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:18.209129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5827e9-64d1-43f5-9001-e00cae9ea8db None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:18.248664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d962398-5be0-4547-8a23-076572eb8381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:18.249922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d962398-5be0-4547-8a23-076572eb8381 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.250443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d962398-5be0-4547-8a23-076572eb8381 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.250937 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d962398-5be0-4547-8a23-076572eb8381 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:18.264076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d962398-5be0-4547-8a23-076572eb8381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:18.271646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-2d962398-5be0-4547-8a23-076572eb8381 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 22 19:39:18.273570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 149/297] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:18.280662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f109b-7906-4811-818e-11b476add6ef None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:18.398610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f109b-7906-4811-818e-11b476add6ef None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:18.425346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da598f1-a1f3-41fc-84c8-146276faf8fa None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.426043 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da598f1-a1f3-41fc-84c8-146276faf8fa None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.426512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da598f1-a1f3-41fc-84c8-146276faf8fa None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:18.428505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 150/298] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:18.434521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea066b-b406-4048-8a80-40e10ecd348b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.435141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea066b-b406-4048-8a80-40e10ecd348b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.435687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea066b-b406-4048-8a80-40e10ecd348b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:18.437798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546635f0-f9e3-4c73-9047-36d0b6d90fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:18.438514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546635f0-f9e3-4c73-9047-36d0b6d90fd5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.438789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546635f0-f9e3-4c73-9047-36d0b6d90fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.439059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546635f0-f9e3-4c73-9047-36d0b6d90fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:18.439807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546635f0-f9e3-4c73-9047-36d0b6d90fd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:18.440107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546635f0-f9e3-4c73-9047-36d0b6d90fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:18.441501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546635f0-f9e3-4c73-9047-36d0b6d90fd5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:18.453697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 149/299] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:18.457247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-67ea066b-b406-4048-8a80-40e10ecd348b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:18.459150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-67ea066b-b406-4048-8a80-40e10ecd348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:18.459281 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546635f0-f9e3-4c73-9047-36d0b6d90fd5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:18.551288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 151/300] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:18.580928 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea066b-b406-4048-8a80-40e10ecd348b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:18.594153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546635f0-f9e3-4c73-9047-36d0b6d90fd5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:18.631770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efcfdf-d0fe-4931-a7a6-aa6cb9afe095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:18.633049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efcfdf-d0fe-4931-a7a6-aa6cb9afe095 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.633544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efcfdf-d0fe-4931-a7a6-aa6cb9afe095 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.634233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efcfdf-d0fe-4931-a7a6-aa6cb9afe095 None admin] PATH_INFO: `/v3/users/d709328f7de64437ac1ccb237e2228e2` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:18.635789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efcfdf-d0fe-4931-a7a6-aa6cb9afe095 None admin] RBAC: Authorizing `identity:get_user(user_id=d709328f7de64437ac1ccb237e2228e2)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:18.637472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efcfdf-d0fe-4931-a7a6-aa6cb9afe095 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:18.639791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 150/301] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:18 2022] GET /identity/v3/users/d709328f7de64437ac1ccb237e2228e2 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:18.646466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efcfdf-d0fe-4931-a7a6-aa6cb9afe095 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:18.703796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea066b-b406-4048-8a80-40e10ecd348b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:18.743236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a499ef1-a074-47e8-8295-6491b9460449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:18.744557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499ef1-a074-47e8-8295-6491b9460449 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.744844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499ef1-a074-47e8-8295-6491b9460449 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.745174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499ef1-a074-47e8-8295-6491b9460449 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:18.758040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a499ef1-a074-47e8-8295-6491b9460449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:18.769695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efcfdf-d0fe-4931-a7a6-aa6cb9afe095 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:18.770175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-0a499ef1-a074-47e8-8295-6491b9460449 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 22 19:39:18.771505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 152/302] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:18.772464 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542b9b9-8702-4138-a38a-0fe9fab6dab9 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.772770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542b9b9-8702-4138-a38a-0fe9fab6dab9 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.773046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542b9b9-8702-4138-a38a-0fe9fab6dab9 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:18.779368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 153/303] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:18.783000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542b9b9-8702-4138-a38a-0fe9fab6dab9 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:18.825394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7521e-dd21-42bd-a798-f9302dcd9656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:18.826604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7521e-dd21-42bd-a798-f9302dcd9656 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.827161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7521e-dd21-42bd-a798-f9302dcd9656 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.827562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7521e-dd21-42bd-a798-f9302dcd9656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:18.918198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542b9b9-8702-4138-a38a-0fe9fab6dab9 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:18.927905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7521e-dd21-42bd-a798-f9302dcd9656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:18.929388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7521e-dd21-42bd-a798-f9302dcd9656 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:18.964238 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6072d2-d0bc-4b2b-9857-3ac5efceb5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:18.965753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6072d2-d0bc-4b2b-9857-3ac5efceb5b3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.966074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6072d2-d0bc-4b2b-9857-3ac5efceb5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.966355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6072d2-d0bc-4b2b-9857-3ac5efceb5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:18.967122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6072d2-d0bc-4b2b-9857-3ac5efceb5b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:18.967428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6072d2-d0bc-4b2b-9857-3ac5efceb5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:18.968828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6072d2-d0bc-4b2b-9857-3ac5efceb5b3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:18.979274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 154/304] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:18.980613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc73c7c-3746-4f0e-b414-4c758955e50c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:18.980892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc73c7c-3746-4f0e-b414-4c758955e50c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:18.981163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc73c7c-3746-4f0e-b414-4c758955e50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.005563 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3bc73c7c-3746-4f0e-b414-4c758955e50c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:19.006932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3bc73c7c-3746-4f0e-b414-4c758955e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:19.049282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 151/305] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:39:19.050376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7521e-dd21-42bd-a798-f9302dcd9656 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:19.106283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 155/306] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:19.106283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc73c7c-3746-4f0e-b414-4c758955e50c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:19.201546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7521e-dd21-42bd-a798-f9302dcd9656 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:19.221199 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc73c7c-3746-4f0e-b414-4c758955e50c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:19.240595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac045e-e247-42c4-a58f-3f4d44ee8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:19.241496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac045e-e247-42c4-a58f-3f4d44ee8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:19.241769 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac045e-e247-42c4-a58f-3f4d44ee8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:19.242075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac045e-e247-42c4-a58f-3f4d44ee8fd3 None admin] PATH_INFO: `/v3/users/5ef73c6697024f31929a769e974b2d4d` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.257185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac045e-e247-42c4-a58f-3f4d44ee8fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=5ef73c6697024f31929a769e974b2d4d)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:19.258895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac045e-e247-42c4-a58f-3f4d44ee8fd3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:19.265994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 152/307] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:19 2022] GET /identity/v3/users/5ef73c6697024f31929a769e974b2d4d => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:19.265994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac045e-e247-42c4-a58f-3f4d44ee8fd3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:19.285780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1dece-30f7-46b6-af2a-5f17ad47e768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:19.287323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1dece-30f7-46b6-af2a-5f17ad47e768 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:19.287804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1dece-30f7-46b6-af2a-5f17ad47e768 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:19.288285 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1dece-30f7-46b6-af2a-5f17ad47e768 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.290677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1dece-30f7-46b6-af2a-5f17ad47e768 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:19.292825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1dece-30f7-46b6-af2a-5f17ad47e768 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:19.296354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 156/308] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:19 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:19.297691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1dece-30f7-46b6-af2a-5f17ad47e768 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:19.405372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac045e-e247-42c4-a58f-3f4d44ee8fd3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:19.427960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1dece-30f7-46b6-af2a-5f17ad47e768 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:19.447613 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4933907-4ae9-4a38-acf0-fba9959f817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:19.448505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933907-4ae9-4a38-acf0-fba9959f817d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:19.448775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933907-4ae9-4a38-acf0-fba9959f817d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:19.449048 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933907-4ae9-4a38-acf0-fba9959f817d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.461416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4933907-4ae9-4a38-acf0-fba9959f817d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:19.469426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-d4933907-4ae9-4a38-acf0-fba9959f817d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:19.470772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 153/309] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:19.472358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7aa68-8662-4902-a21c-6afe6b8fb88e None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:19.472562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7aa68-8662-4902-a21c-6afe6b8fb88e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:19.472812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7aa68-8662-4902-a21c-6afe6b8fb88e None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.475108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 154/310] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:19.475973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7aa68-8662-4902-a21c-6afe6b8fb88e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:19.493079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4b72-ec3e-4576-8e0b-02b4519c0e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:19.494442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4b72-ec3e-4576-8e0b-02b4519c0e24 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:19.494733 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4b72-ec3e-4576-8e0b-02b4519c0e24 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:19.495002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4b72-ec3e-4576-8e0b-02b4519c0e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.495866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd4b72-ec3e-4576-8e0b-02b4519c0e24 None admin] RBAC: Adding query filter params (role.id=8970adb53a594bf68973ee9679c03bcd, user.id=5ef73c6697024f31929a769e974b2d4d, scope.system=all) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:19.496176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd4b72-ec3e-4576-8e0b-02b4519c0e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:19.497688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd4b72-ec3e-4576-8e0b-02b4519c0e24 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:19.503755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 157/311] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Mar 22 19:39:19 2022] GET /identity/v3/role_assignments?user.id=5ef73c6697024f31929a769e974b2d4d&scope.system=all&role.id=8970adb53a594bf68973ee9679c03bcd => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:19.504638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4b72-ec3e-4576-8e0b-02b4519c0e24 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:19.660448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4b72-ec3e-4576-8e0b-02b4519c0e24 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:19.670284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7aa68-8662-4902-a21c-6afe6b8fb88e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:19.710216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641056c-c6b9-4c63-8eec-940a090ddbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:19.711742 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641056c-c6b9-4c63-8eec-940a090ddbbe None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:19.712555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641056c-c6b9-4c63-8eec-940a090ddbbe None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:19.713261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641056c-c6b9-4c63-8eec-940a090ddbbe None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.714666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641056c-c6b9-4c63-8eec-940a090ddbbe None admin] RBAC: Adding query filter params (name=member) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:19.715056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641056c-c6b9-4c63-8eec-940a090ddbbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:19.717193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641056c-c6b9-4c63-8eec-940a090ddbbe None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:19.741573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8684b-214d-4d56-8096-43f689298bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:19.741840 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 158/312] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:19.742027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8684b-214d-4d56-8096-43f689298bf6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:19.742027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8684b-214d-4d56-8096-43f689298bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:19.742027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8684b-214d-4d56-8096-43f689298bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.742430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd2745-2a14-4fcd-9d37-71c3ba9d6ec9 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:19.742430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd2745-2a14-4fcd-9d37-71c3ba9d6ec9 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:19.742430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd2745-2a14-4fcd-9d37-71c3ba9d6ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.742822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8684b-214d-4d56-8096-43f689298bf6 None admin] RBAC: Adding query filter params (role.id=8970adb53a594bf68973ee9679c03bcd, scope.project.id=2d0172f0deac4b64babafdb092e05fd8, user.id=d709328f7de64437ac1ccb237e2228e2) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:19.742822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8684b-214d-4d56-8096-43f689298bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:19.742822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8684b-214d-4d56-8096-43f689298bf6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:19.748213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 155/313] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:19 2022] GET /identity/v3/role_assignments?user.id=d709328f7de64437ac1ccb237e2228e2&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=8970adb53a594bf68973ee9679c03bcd => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:19.749079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8684b-214d-4d56-8096-43f689298bf6 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:19.769022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-95cd2745-2a14-4fcd-9d37-71c3ba9d6ec9 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:19.770752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-95cd2745-2a14-4fcd-9d37-71c3ba9d6ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:19.885294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 159/314] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:19.909810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8684b-214d-4d56-8096-43f689298bf6 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:19.923826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd2745-2a14-4fcd-9d37-71c3ba9d6ec9 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:19.953752 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8e91a-ece9-479f-88b0-2b5b59145667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:19.954699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8e91a-ece9-479f-88b0-2b5b59145667 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:19.954973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8e91a-ece9-479f-88b0-2b5b59145667 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:19.955237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8e91a-ece9-479f-88b0-2b5b59145667 None admin] PATH_INFO: `/v3/users/d95ea2386b7b4973ba99c54e2ba81f2e` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:19.956608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8e91a-ece9-479f-88b0-2b5b59145667 None admin] RBAC: Authorizing `identity:get_user(user_id=d95ea2386b7b4973ba99c54e2ba81f2e)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:19.958154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8e91a-ece9-479f-88b0-2b5b59145667 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:19.960294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 156/315] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:19 2022] GET /identity/v3/users/d95ea2386b7b4973ba99c54e2ba81f2e => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:19.969995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8e91a-ece9-479f-88b0-2b5b59145667 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:20.125221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd2745-2a14-4fcd-9d37-71c3ba9d6ec9 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:20.160772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8e91a-ece9-479f-88b0-2b5b59145667 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:20.169778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b02e9d-80e6-4313-ad4f-884cf239a9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:20.170636 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02e9d-80e6-4313-ad4f-884cf239a9e8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:20.170911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02e9d-80e6-4313-ad4f-884cf239a9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:20.171179 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02e9d-80e6-4313-ad4f-884cf239a9e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:20.172426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b02e9d-80e6-4313-ad4f-884cf239a9e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:20.174313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b02e9d-80e6-4313-ad4f-884cf239a9e8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:20.176911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 160/316] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:20.182947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b02e9d-80e6-4313-ad4f-884cf239a9e8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:20.220005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec147e-8e54-4f12-9059-8904023ccab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:20.221182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec147e-8e54-4f12-9059-8904023ccab9 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:20.221606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec147e-8e54-4f12-9059-8904023ccab9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:20.222069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec147e-8e54-4f12-9059-8904023ccab9 None admin] PATH_INFO: `/v3/system/users/d95ea2386b7b4973ba99c54e2ba81f2e/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:20.224330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec147e-8e54-4f12-9059-8904023ccab9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d95ea2386b7b4973ba99c54e2ba81f2e, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:20.225988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec147e-8e54-4f12-9059-8904023ccab9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:20.238698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 157/317] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Mar 22 19:39:19 2022] PUT /identity/v3/system/users/d95ea2386b7b4973ba99c54e2ba81f2e/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:39:20.362302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b02e9d-80e6-4313-ad4f-884cf239a9e8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:20.429587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32778be-bd7c-41e2-aee4-7dcbc4eadfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:20.430671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32778be-bd7c-41e2-aee4-7dcbc4eadfb4 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:20.431547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32778be-bd7c-41e2-aee4-7dcbc4eadfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:20.431687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32778be-bd7c-41e2-aee4-7dcbc4eadfb4 None admin] PATH_INFO: `/v3/groups` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:20.433105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32778be-bd7c-41e2-aee4-7dcbc4eadfb4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:20.436409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32778be-bd7c-41e2-aee4-7dcbc4eadfb4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:20.463085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 161/318] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Mar 22 19:39:20 2022] POST /identity/v3/groups => generated 229 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:39:22.025976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b034-d43e-45f9-94cf-4c0af0f0f40e None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:22.026779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b034-d43e-45f9-94cf-4c0af0f0f40e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:22.026779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b034-d43e-45f9-94cf-4c0af0f0f40e None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:22.028586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 158/319] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:22.035012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62158b-87ad-4ff0-a38f-40a16cc9130d None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:22.035511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62158b-87ad-4ff0-a38f-40a16cc9130d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:22.036158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62158b-87ad-4ff0-a38f-40a16cc9130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:22.062936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-fa62158b-87ad-4ff0-a38f-40a16cc9130d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:22.064906 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-fa62158b-87ad-4ff0-a38f-40a16cc9130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:22.166044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 162/320] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:22.182336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765b034-d43e-45f9-94cf-4c0af0f0f40e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:22.292975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765b034-d43e-45f9-94cf-4c0af0f0f40e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:22.331040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511e611-cd6f-4dad-a530-61ab4b47eb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:22.332198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511e611-cd6f-4dad-a530-61ab4b47eb4f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:22.332665 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511e611-cd6f-4dad-a530-61ab4b47eb4f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:22.333125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511e611-cd6f-4dad-a530-61ab4b47eb4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:22.346358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511e611-cd6f-4dad-a530-61ab4b47eb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:22.354462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-d511e611-cd6f-4dad-a530-61ab4b47eb4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 22 19:39:22.356499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 159/321] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:22.366142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62158b-87ad-4ff0-a38f-40a16cc9130d None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:22.572113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62158b-87ad-4ff0-a38f-40a16cc9130d None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:22.635271 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c62d57-c96d-425c-889c-a689c8a5e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:22.636427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62d57-c96d-425c-889c-a689c8a5e2bd None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:22.636914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62d57-c96d-425c-889c-a689c8a5e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:22.637407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62d57-c96d-425c-889c-a689c8a5e2bd None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:22.638739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c62d57-c96d-425c-889c-a689c8a5e2bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:22.639289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c62d57-c96d-425c-889c-a689c8a5e2bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:22.641923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c62d57-c96d-425c-889c-a689c8a5e2bd None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:22.658375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 163/322] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:22.668150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511e611-cd6f-4dad-a530-61ab4b47eb4f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:22.778577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511e611-cd6f-4dad-a530-61ab4b47eb4f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:22.814396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be46b6-e533-468f-b40d-349d68bf8cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:22.815297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be46b6-e533-468f-b40d-349d68bf8cd2 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:22.815574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be46b6-e533-468f-b40d-349d68bf8cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:22.815850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be46b6-e533-468f-b40d-349d68bf8cd2 None admin] PATH_INFO: `/v3/users/5ef73c6697024f31929a769e974b2d4d` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:22.817130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be46b6-e533-468f-b40d-349d68bf8cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=5ef73c6697024f31929a769e974b2d4d)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:22.818672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be46b6-e533-468f-b40d-349d68bf8cd2 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:22.826069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 160/323] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:22 2022] GET /identity/v3/users/5ef73c6697024f31929a769e974b2d4d => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:22.833617 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c62d57-c96d-425c-889c-a689c8a5e2bd None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:22.870307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4a900-636c-4fcc-8a49-9d232de88a69 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:22.870611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4a900-636c-4fcc-8a49-9d232de88a69 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:22.870944 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4a900-636c-4fcc-8a49-9d232de88a69 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:22.872940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 161/324] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:22.878358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c694-34ea-42a0-aed4-6d4a7d704eed None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:22.878717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c694-34ea-42a0-aed4-6d4a7d704eed None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:22.878960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c694-34ea-42a0-aed4-6d4a7d704eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:22.896840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c674c694-34ea-42a0-aed4-6d4a7d704eed None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:22.898098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c674c694-34ea-42a0-aed4-6d4a7d704eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:22.948294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c62d57-c96d-425c-889c-a689c8a5e2bd None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:22.975438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 162/325] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:22.989221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896821d-9340-482f-aac3-4de0dd47527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:22.990336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896821d-9340-482f-aac3-4de0dd47527e None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:22.990742 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896821d-9340-482f-aac3-4de0dd47527e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:22.991137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896821d-9340-482f-aac3-4de0dd47527e None admin] PATH_INFO: `/v3/system/users/5ef73c6697024f31929a769e974b2d4d/roles/8970adb53a594bf68973ee9679c03bcd` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:22.992922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896821d-9340-482f-aac3-4de0dd47527e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5ef73c6697024f31929a769e974b2d4d, role_id=8970adb53a594bf68973ee9679c03bcd)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:22.994636 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896821d-9340-482f-aac3-4de0dd47527e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:22.999234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674c694-34ea-42a0-aed4-6d4a7d704eed None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:23.006602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 164/326] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Mar 22 19:39:22 2022] PUT /identity/v3/system/users/5ef73c6697024f31929a769e974b2d4d/roles/8970adb53a594bf68973ee9679c03bcd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:39:23.125560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674c694-34ea-42a0-aed4-6d4a7d704eed None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:23.174130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed580406-10c4-4d65-bfde-fecddacbed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:23.175571 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed580406-10c4-4d65-bfde-fecddacbed22 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:23.176055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed580406-10c4-4d65-bfde-fecddacbed22 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:23.176534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed580406-10c4-4d65-bfde-fecddacbed22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:23.197817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed580406-10c4-4d65-bfde-fecddacbed22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:23.211664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-ed580406-10c4-4d65-bfde-fecddacbed22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:23.214316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 163/327] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:23.222953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896821d-9340-482f-aac3-4de0dd47527e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:23.334058 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896821d-9340-482f-aac3-4de0dd47527e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:23.380766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffc5f9-6179-44c1-89c8-57240d031fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:23.381839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffc5f9-6179-44c1-89c8-57240d031fc2 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:23.382383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffc5f9-6179-44c1-89c8-57240d031fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:23.382910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffc5f9-6179-44c1-89c8-57240d031fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:23.385231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffc5f9-6179-44c1-89c8-57240d031fc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:23.385780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffc5f9-6179-44c1-89c8-57240d031fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:23.388434 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffc5f9-6179-44c1-89c8-57240d031fc2 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:23.404219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 165/328] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:23.413390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed580406-10c4-4d65-bfde-fecddacbed22 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:23.601888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed580406-10c4-4d65-bfde-fecddacbed22 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:23.664787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347cd7-70b3-44b5-a928-1b407018ea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:23.666169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347cd7-70b3-44b5-a928-1b407018ea14 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:23.666580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347cd7-70b3-44b5-a928-1b407018ea14 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:23.666998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347cd7-70b3-44b5-a928-1b407018ea14 None admin] PATH_INFO: `/v3/users/d95ea2386b7b4973ba99c54e2ba81f2e` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:23.669046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347cd7-70b3-44b5-a928-1b407018ea14 None admin] RBAC: Authorizing `identity:get_user(user_id=d95ea2386b7b4973ba99c54e2ba81f2e)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:23.671659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347cd7-70b3-44b5-a928-1b407018ea14 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:23.674675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 164/329] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:23 2022] GET /identity/v3/users/d95ea2386b7b4973ba99c54e2ba81f2e => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:23.683140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffc5f9-6179-44c1-89c8-57240d031fc2 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:23.797081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffc5f9-6179-44c1-89c8-57240d031fc2 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:23.847226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821b889-7ff8-4e67-ac37-b3383cdeb91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:23.849716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b889-7ff8-4e67-ac37-b3383cdeb91e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:23.849716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b889-7ff8-4e67-ac37-b3383cdeb91e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:23.850067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b889-7ff8-4e67-ac37-b3383cdeb91e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:23.851113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821b889-7ff8-4e67-ac37-b3383cdeb91e None admin] RBAC: Adding query filter params (role.id=a50cc38d78674f6eaffc44a0a26ed453, user.id=d95ea2386b7b4973ba99c54e2ba81f2e, scope.system=all) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:23.851605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821b889-7ff8-4e67-ac37-b3383cdeb91e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:23.853679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821b889-7ff8-4e67-ac37-b3383cdeb91e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:23.874066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 166/330] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Mar 22 19:39:23 2022] GET /identity/v3/role_assignments?user.id=d95ea2386b7b4973ba99c54e2ba81f2e&scope.system=all&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:23.991886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cdf69-4aba-428c-8bac-aac989eb7fb0 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:23.992424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cdf69-4aba-428c-8bac-aac989eb7fb0 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:23.992990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cdf69-4aba-428c-8bac-aac989eb7fb0 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:23.995848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 165/331] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:24.005174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c35d6-2c7d-4fde-8543-4df3d484a109 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:24.005692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c35d6-2c7d-4fde-8543-4df3d484a109 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:24.006224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c35d6-2c7d-4fde-8543-4df3d484a109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:24.035619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-479c35d6-2c7d-4fde-8543-4df3d484a109 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:24.037622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-479c35d6-2c7d-4fde-8543-4df3d484a109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:24.144121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 167/332] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:24.167077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cdf69-4aba-428c-8bac-aac989eb7fb0 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:24.296665 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cdf69-4aba-428c-8bac-aac989eb7fb0 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:24.333024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97911f89-8b9a-477d-8021-c3285c28cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:24.333836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97911f89-8b9a-477d-8021-c3285c28cec0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:24.334145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97911f89-8b9a-477d-8021-c3285c28cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:24.334420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97911f89-8b9a-477d-8021-c3285c28cec0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:24.335592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97911f89-8b9a-477d-8021-c3285c28cec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:24.337345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97911f89-8b9a-477d-8021-c3285c28cec0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:24.339582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 166/333] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:24.345263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c35d6-2c7d-4fde-8543-4df3d484a109 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:24.450725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c35d6-2c7d-4fde-8543-4df3d484a109 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:24.488051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2a96-0043-4fbd-8b9d-073bafd30738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:24.488736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2a96-0043-4fbd-8b9d-073bafd30738 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:24.489012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2a96-0043-4fbd-8b9d-073bafd30738 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:24.489284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2a96-0043-4fbd-8b9d-073bafd30738 None admin] PATH_INFO: `/v3/groups` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:24.490025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2a96-0043-4fbd-8b9d-073bafd30738 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:24.491477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2a96-0043-4fbd-8b9d-073bafd30738 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:24.510425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 168/334] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Mar 22 19:39:24 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:39:25.779365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b17b4-83ef-444d-a8ca-d830d71e1b3d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:25.779903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b17b4-83ef-444d-a8ca-d830d71e1b3d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:25.779903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b17b4-83ef-444d-a8ca-d830d71e1b3d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:25.782201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 167/335] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:25.788392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35e3a1-4b72-4cd6-96d7-135ce2c51180 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:25.789382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35e3a1-4b72-4cd6-96d7-135ce2c51180 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:25.789898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35e3a1-4b72-4cd6-96d7-135ce2c51180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:25.813794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0e35e3a1-4b72-4cd6-96d7-135ce2c51180 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:25.820008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0e35e3a1-4b72-4cd6-96d7-135ce2c51180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:25.969091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 169/336] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:26.013905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b17b4-83ef-444d-a8ca-d830d71e1b3d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:26.143715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b17b4-83ef-444d-a8ca-d830d71e1b3d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:26.189594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2c98c-8cc9-436e-89fa-7c6e3ff46193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:26.190481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2c98c-8cc9-436e-89fa-7c6e3ff46193 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:26.190756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2c98c-8cc9-436e-89fa-7c6e3ff46193 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:26.191030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2c98c-8cc9-436e-89fa-7c6e3ff46193 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:26.206051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2c98c-8cc9-436e-89fa-7c6e3ff46193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:26.213535 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-fff2c98c-8cc9-436e-89fa-7c6e3ff46193 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 22 19:39:26.215265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 168/337] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:26.222053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35e3a1-4b72-4cd6-96d7-135ce2c51180 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:26.394035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35e3a1-4b72-4cd6-96d7-135ce2c51180 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:26.438911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b18f9-5379-4fcb-9ead-7533a2341bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:26.439625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b18f9-5379-4fcb-9ead-7533a2341bcf None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:26.439875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b18f9-5379-4fcb-9ead-7533a2341bcf None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:26.440146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b18f9-5379-4fcb-9ead-7533a2341bcf None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:26.440913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b18f9-5379-4fcb-9ead-7533a2341bcf None admin] RBAC: Adding query filter params (name=reader) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:26.441217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b18f9-5379-4fcb-9ead-7533a2341bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:26.442646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b18f9-5379-4fcb-9ead-7533a2341bcf None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:26.454439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 170/338] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:26.463133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2c98c-8cc9-436e-89fa-7c6e3ff46193 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:26.593319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2c98c-8cc9-436e-89fa-7c6e3ff46193 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:26.637692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf444e-a765-47cc-ad34-a87380355602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:26.638627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf444e-a765-47cc-ad34-a87380355602 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:26.638906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf444e-a765-47cc-ad34-a87380355602 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:26.639178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf444e-a765-47cc-ad34-a87380355602 None admin] PATH_INFO: `/v3/users/5ef73c6697024f31929a769e974b2d4d` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:26.640432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf444e-a765-47cc-ad34-a87380355602 None admin] RBAC: Authorizing `identity:get_user(user_id=5ef73c6697024f31929a769e974b2d4d)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:26.641908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf444e-a765-47cc-ad34-a87380355602 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:26.643648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 169/339] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:39:26 2022] GET /identity/v3/users/5ef73c6697024f31929a769e974b2d4d => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:26.649777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b18f9-5379-4fcb-9ead-7533a2341bcf None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:26.856394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b18f9-5379-4fcb-9ead-7533a2341bcf None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:26.901422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d534e-5cec-4b2b-951d-ab8f42593381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:26.902492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d534e-5cec-4b2b-951d-ab8f42593381 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:26.902992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d534e-5cec-4b2b-951d-ab8f42593381 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:26.903472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d534e-5cec-4b2b-951d-ab8f42593381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:26.904525 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d534e-5cec-4b2b-951d-ab8f42593381 None admin] RBAC: Adding query filter params (role.id=8970adb53a594bf68973ee9679c03bcd, user.id=5ef73c6697024f31929a769e974b2d4d, scope.system=all) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:26.905052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d534e-5cec-4b2b-951d-ab8f42593381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:26.906770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d534e-5cec-4b2b-951d-ab8f42593381 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:26.924980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 171/340] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Mar 22 19:39:26 2022] GET /identity/v3/role_assignments?user.id=5ef73c6697024f31929a769e974b2d4d&scope.system=all&role.id=8970adb53a594bf68973ee9679c03bcd => generated 510 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:27.766137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f5f5-d4fd-4256-8e6e-317b0beb8d04 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:27.766679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f5f5-d4fd-4256-8e6e-317b0beb8d04 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:27.767116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f5f5-d4fd-4256-8e6e-317b0beb8d04 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:27.770784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 170/341] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:27.785135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7320804-41aa-437b-88b0-978d51d0ab9d None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:27.785775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7320804-41aa-437b-88b0-978d51d0ab9d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:27.786305 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7320804-41aa-437b-88b0-978d51d0ab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:27.809991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b7320804-41aa-437b-88b0-978d51d0ab9d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:27.811574 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b7320804-41aa-437b-88b0-978d51d0ab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:27.916390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 172/342] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:27.969913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f5f5-d4fd-4256-8e6e-317b0beb8d04 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:28.017144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3e05e-e91d-4eb6-8e49-b92b5f5e7524 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:28.017768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3e05e-e91d-4eb6-8e49-b92b5f5e7524 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:28.018295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3e05e-e91d-4eb6-8e49-b92b5f5e7524 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:28.021982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 173/343] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:28.026329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ba184-bef0-4e94-b50d-b347335c7837 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:28.026956 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ba184-bef0-4e94-b50d-b347335c7837 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:28.027446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ba184-bef0-4e94-b50d-b347335c7837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:28.177865 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c43ba184-bef0-4e94-b50d-b347335c7837 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:28.179571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c43ba184-bef0-4e94-b50d-b347335c7837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:28.220221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f5f5-d4fd-4256-8e6e-317b0beb8d04 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:28.254052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 174/344] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:28.276014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef522-7a83-4cfd-b619-c1ff46e88a19 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:28.276616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef522-7a83-4cfd-b619-c1ff46e88a19 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:28.277115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef522-7a83-4cfd-b619-c1ff46e88a19 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:28.281160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 175/345] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:28.282377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef522-7a83-4cfd-b619-c1ff46e88a19 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:28.288810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175c20c-3412-42b7-9e1c-fcbf72e929e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:28.289641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c20c-3412-42b7-9e1c-fcbf72e929e9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:28.290347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c20c-3412-42b7-9e1c-fcbf72e929e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:28.290347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175c20c-3412-42b7-9e1c-fcbf72e929e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:28.305899 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175c20c-3412-42b7-9e1c-fcbf72e929e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:28.314534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a175c20c-3412-42b7-9e1c-fcbf72e929e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:28.316657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 171/346] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:28.318475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649ed3d-b201-4395-b622-1d61d79d9b72 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:28.318991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649ed3d-b201-4395-b622-1d61d79d9b72 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:28.319482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649ed3d-b201-4395-b622-1d61d79d9b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:28.349156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-3649ed3d-b201-4395-b622-1d61d79d9b72 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:28.350834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3649ed3d-b201-4395-b622-1d61d79d9b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:28.405211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef522-7a83-4cfd-b619-c1ff46e88a19 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:28.441231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93963c-164f-47ec-aa51-fc11605b71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:28.442113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93963c-164f-47ec-aa51-fc11605b71b0 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:28.442408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93963c-164f-47ec-aa51-fc11605b71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:28.442687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93963c-164f-47ec-aa51-fc11605b71b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:28.450630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 172/347] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:28.452955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649ed3d-b201-4395-b622-1d61d79d9b72 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:28.464657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93963c-164f-47ec-aa51-fc11605b71b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:28.472146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-0c93963c-164f-47ec-aa51-fc11605b71b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:28.474048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 176/348] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:28.480024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93963c-164f-47ec-aa51-fc11605b71b0 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:28.575462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649ed3d-b201-4395-b622-1d61d79d9b72 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:28.615822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93963c-164f-47ec-aa51-fc11605b71b0 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:28.648396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622b827-8098-4156-8f4d-f8449c654c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:28.649623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622b827-8098-4156-8f4d-f8449c654c19 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:28.650185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622b827-8098-4156-8f4d-f8449c654c19 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:28.650796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622b827-8098-4156-8f4d-f8449c654c19 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:28.652131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622b827-8098-4156-8f4d-f8449c654c19 None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:28.652625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622b827-8098-4156-8f4d-f8449c654c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:28.654131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350ae05-0d14-4d1d-86b7-23fae070c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:28.655014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350ae05-0d14-4d1d-86b7-23fae070c0ab None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:28.655328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622b827-8098-4156-8f4d-f8449c654c19 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:28.655601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350ae05-0d14-4d1d-86b7-23fae070c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:28.656021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350ae05-0d14-4d1d-86b7-23fae070c0ab None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:28.656931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350ae05-0d14-4d1d-86b7-23fae070c0ab None admin] RBAC: Adding query filter params (name=member) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:28.657394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350ae05-0d14-4d1d-86b7-23fae070c0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:28.658964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350ae05-0d14-4d1d-86b7-23fae070c0ab None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:28.668994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 177/349] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:28.674236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350ae05-0d14-4d1d-86b7-23fae070c0ab None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:28.674649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 173/350] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:28.678082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622b827-8098-4156-8f4d-f8449c654c19 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:28.797652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350ae05-0d14-4d1d-86b7-23fae070c0ab None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:28.847160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba383f-fd10-479a-b660-70c948cc9634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:28.847721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba383f-fd10-479a-b660-70c948cc9634 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:28.848002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba383f-fd10-479a-b660-70c948cc9634 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:28.848276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba383f-fd10-479a-b660-70c948cc9634 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:28.865477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba383f-fd10-479a-b660-70c948cc9634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:28.876086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-acba383f-fd10-479a-b660-70c948cc9634 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:39:28.879020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 178/351] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:39:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:28.884616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba383f-fd10-479a-b660-70c948cc9634 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:28.974600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622b827-8098-4156-8f4d-f8449c654c19 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:29.015167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4659-acf9-457f-9064-1bc6dfa4f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:29.015841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4659-acf9-457f-9064-1bc6dfa4f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:29.016596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4659-acf9-457f-9064-1bc6dfa4f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:29.016596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c4659-acf9-457f-9064-1bc6dfa4f9a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:29.032391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba383f-fd10-479a-b660-70c948cc9634 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:29.081449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4cb3e-2c04-43c1-b962-8a179be75fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:29.082829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4cb3e-2c04-43c1-b962-8a179be75fa9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:29.083322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4cb3e-2c04-43c1-b962-8a179be75fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:29.083948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4cb3e-2c04-43c1-b962-8a179be75fa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:29.098039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c4659-acf9-457f-9064-1bc6dfa4f9a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:29.100131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c4659-acf9-457f-9064-1bc6dfa4f9a7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:29.171809 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4cb3e-2c04-43c1-b962-8a179be75fa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:29.173404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4cb3e-2c04-43c1-b962-8a179be75fa9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:29.235369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 174/352] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:39:29.237309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4659-acf9-457f-9064-1bc6dfa4f9a7 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:29.287863 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 179/353] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:29.289006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4cb3e-2c04-43c1-b962-8a179be75fa9 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:29.371718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c4659-acf9-457f-9064-1bc6dfa4f9a7 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:29.408121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4cb3e-2c04-43c1-b962-8a179be75fa9 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:29.416035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22cc66-7737-4da8-a4c5-697fb057d770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:29.416855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22cc66-7737-4da8-a4c5-697fb057d770 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:29.417204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22cc66-7737-4da8-a4c5-697fb057d770 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:29.417547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22cc66-7737-4da8-a4c5-697fb057d770 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:29.418550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22cc66-7737-4da8-a4c5-697fb057d770 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:29.418956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22cc66-7737-4da8-a4c5-697fb057d770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:29.420484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22cc66-7737-4da8-a4c5-697fb057d770 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:29.429921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 175/354] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:29.431021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22cc66-7737-4da8-a4c5-697fb057d770 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:29.453923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0280b5-d83e-4f46-b5a4-dc008acebc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:29.455241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0280b5-d83e-4f46-b5a4-dc008acebc04 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:29.455726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0280b5-d83e-4f46-b5a4-dc008acebc04 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:29.456198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0280b5-d83e-4f46-b5a4-dc008acebc04 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:29.457762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0280b5-d83e-4f46-b5a4-dc008acebc04 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:29.460187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0280b5-d83e-4f46-b5a4-dc008acebc04 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:29.462789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 180/355] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:29 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:29.464523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0280b5-d83e-4f46-b5a4-dc008acebc04 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:29.551979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22cc66-7737-4da8-a4c5-697fb057d770 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:29.580756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0280b5-d83e-4f46-b5a4-dc008acebc04 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:29.588977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc3ff1-04cb-4d03-9344-11b9cba8f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:29.590289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc3ff1-04cb-4d03-9344-11b9cba8f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:29.590779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc3ff1-04cb-4d03-9344-11b9cba8f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:29.591269 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc3ff1-04cb-4d03-9344-11b9cba8f1e2 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:29.592837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc3ff1-04cb-4d03-9344-11b9cba8f1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:29.594610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc3ff1-04cb-4d03-9344-11b9cba8f1e2 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:29.597010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 176/356] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:29 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:29.598097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc3ff1-04cb-4d03-9344-11b9cba8f1e2 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:29.620616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d3ff6-7050-4fc1-923c-c906e7613fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:29.621342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d3ff6-7050-4fc1-923c-c906e7613fa1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:29.621625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d3ff6-7050-4fc1-923c-c906e7613fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:29.621982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d3ff6-7050-4fc1-923c-c906e7613fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:29.700647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d3ff6-7050-4fc1-923c-c906e7613fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:29.702378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d3ff6-7050-4fc1-923c-c906e7613fa1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:29.709977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc3ff1-04cb-4d03-9344-11b9cba8f1e2 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:29.747381 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66103e-a2c5-4569-98b7-651902f69b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:29.748677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66103e-a2c5-4569-98b7-651902f69b62 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:29.749186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66103e-a2c5-4569-98b7-651902f69b62 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:29.749668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66103e-a2c5-4569-98b7-651902f69b62 None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:29.759171 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66103e-a2c5-4569-98b7-651902f69b62 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:29.761158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66103e-a2c5-4569-98b7-651902f69b62 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:29.763257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 177/357] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:29 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:29.764364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66103e-a2c5-4569-98b7-651902f69b62 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:29.822147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 181/358] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:29.823158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d3ff6-7050-4fc1-923c-c906e7613fa1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:29.882850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66103e-a2c5-4569-98b7-651902f69b62 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:29.933088 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78aea6-2c4a-4202-a442-e0e3348f7188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:29.934091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78aea6-2c4a-4202-a442-e0e3348f7188 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:29.934381 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78aea6-2c4a-4202-a442-e0e3348f7188 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:29.934657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78aea6-2c4a-4202-a442-e0e3348f7188 None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:29.935970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78aea6-2c4a-4202-a442-e0e3348f7188 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:29.937608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78aea6-2c4a-4202-a442-e0e3348f7188 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:29.941353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 178/359] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:29 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:29.942308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78aea6-2c4a-4202-a442-e0e3348f7188 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:29.948002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d3ff6-7050-4fc1-923c-c906e7613fa1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:29.992361 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6d838-a4ac-48fe-b1e0-1a95b75fb363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:29.993903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d838-a4ac-48fe-b1e0-1a95b75fb363 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:29.994385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d838-a4ac-48fe-b1e0-1a95b75fb363 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:29.994826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d838-a4ac-48fe-b1e0-1a95b75fb363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:29.996051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6d838-a4ac-48fe-b1e0-1a95b75fb363 None admin] RBAC: Adding query filter params (group.id=bf0bd7afe02c413585f98edb81d4ffac, role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:29.996548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6d838-a4ac-48fe-b1e0-1a95b75fb363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:29.998681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6d838-a4ac-48fe-b1e0-1a95b75fb363 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:30.005660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 182/360] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:29 2022] GET /identity/v3/role_assignments?group.id=bf0bd7afe02c413585f98edb81d4ffac&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:30.006921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075dd25-a420-42c0-99ad-4971193f0a51 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.007233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075dd25-a420-42c0-99ad-4971193f0a51 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.007643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075dd25-a420-42c0-99ad-4971193f0a51 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.010078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 183/361] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:30.010916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075dd25-a420-42c0-99ad-4971193f0a51 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:30.146350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78aea6-2c4a-4202-a442-e0e3348f7188 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:30.178737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075dd25-a420-42c0-99ad-4971193f0a51 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:30.198519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cf8b0-e17a-4306-a504-f521a6660e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:30.199457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cf8b0-e17a-4306-a504-f521a6660e78 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.199737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cf8b0-e17a-4306-a504-f521a6660e78 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.200016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cf8b0-e17a-4306-a504-f521a6660e78 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.202203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cf8b0-e17a-4306-a504-f521a6660e78 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:30.203847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cf8b0-e17a-4306-a504-f521a6660e78 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:30.206528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 179/362] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:29 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:30.208858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd604e-e2d3-4acd-9040-9637775f939a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.209328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd604e-e2d3-4acd-9040-9637775f939a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.209803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd604e-e2d3-4acd-9040-9637775f939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.234661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c5bd604e-e2d3-4acd-9040-9637775f939a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:30.236632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c5bd604e-e2d3-4acd-9040-9637775f939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:30.267290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281de46-880d-480c-aec3-f2149517d8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:30.268683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281de46-880d-480c-aec3-f2149517d8a7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.269136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281de46-880d-480c-aec3-f2149517d8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.269608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281de46-880d-480c-aec3-f2149517d8a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.272166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281de46-880d-480c-aec3-f2149517d8a7 None admin] RBAC: Adding query filter params (group.id=bf0bd7afe02c413585f98edb81d4ffac, role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=2d0172f0deac4b64babafdb092e05fd8) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:30.272683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281de46-880d-480c-aec3-f2149517d8a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:30.277191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281de46-880d-480c-aec3-f2149517d8a7 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:30.286890 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 184/363] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:30 2022] GET /identity/v3/role_assignments?group.id=bf0bd7afe02c413585f98edb81d4ffac&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:30.288143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281de46-880d-480c-aec3-f2149517d8a7 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:30.383183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 180/364] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:30.384973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374111-19a8-4f1d-b831-8e000644d046 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.385264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374111-19a8-4f1d-b831-8e000644d046 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.385612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374111-19a8-4f1d-b831-8e000644d046 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.391860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 181/365] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:30.393833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cdfc-1d37-4744-abe6-ac93b5e050ca None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.394279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cdfc-1d37-4744-abe6-ac93b5e050ca None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.394683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cdfc-1d37-4744-abe6-ac93b5e050ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.415200 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-55f8cdfc-1d37-4744-abe6-ac93b5e050ca None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:30.416477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-55f8cdfc-1d37-4744-abe6-ac93b5e050ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:30.428116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281de46-880d-480c-aec3-f2149517d8a7 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:30.481385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d3879-2ba9-4e68-8638-d4535a1c92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:30.483378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d3879-2ba9-4e68-8638-d4535a1c92b3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.483796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d3879-2ba9-4e68-8638-d4535a1c92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.484737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d3879-2ba9-4e68-8638-d4535a1c92b3 None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.487313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d3879-2ba9-4e68-8638-d4535a1c92b3 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:30.490723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d3879-2ba9-4e68-8638-d4535a1c92b3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:30.494922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 185/366] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:30 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:30.496956 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d3879-2ba9-4e68-8638-d4535a1c92b3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:30.526119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 182/367] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:30.527279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8cdfc-1d37-4744-abe6-ac93b5e050ca None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:30.675087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8cdfc-1d37-4744-abe6-ac93b5e050ca None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:30.689905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d3879-2ba9-4e68-8638-d4535a1c92b3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:30.715385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04770db0-3023-42b2-9680-ae0d5f23459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:30.716371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770db0-3023-42b2-9680-ae0d5f23459b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.716809 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770db0-3023-42b2-9680-ae0d5f23459b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.717237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770db0-3023-42b2-9680-ae0d5f23459b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.718467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04770db0-3023-42b2-9680-ae0d5f23459b None admin] RBAC: Adding query filter params (group.id=bf0bd7afe02c413585f98edb81d4ffac, role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:30.718958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04770db0-3023-42b2-9680-ae0d5f23459b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:30.720612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04770db0-3023-42b2-9680-ae0d5f23459b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:30.727687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 183/368] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:30 2022] GET /identity/v3/role_assignments?group.id=bf0bd7afe02c413585f98edb81d4ffac&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:30.728806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04770db0-3023-42b2-9680-ae0d5f23459b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:30.730581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5cd20-673f-4bff-b628-12ca8e423964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:30.731432 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5cd20-673f-4bff-b628-12ca8e423964 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.731716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5cd20-673f-4bff-b628-12ca8e423964 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.731992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5cd20-673f-4bff-b628-12ca8e423964 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.745102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5cd20-673f-4bff-b628-12ca8e423964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:30.752691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-92b5cd20-673f-4bff-b628-12ca8e423964 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:39:30.754278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 186/369] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:39:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:30.768392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5cd20-673f-4bff-b628-12ca8e423964 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:30.911298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04770db0-3023-42b2-9680-ae0d5f23459b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:30.974045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf3ac-ffba-4bc6-b17e-39c418b56920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:30.975508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf3ac-ffba-4bc6-b17e-39c418b56920 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:30.975977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf3ac-ffba-4bc6-b17e-39c418b56920 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:30.976447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abf3ac-ffba-4bc6-b17e-39c418b56920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:30.978382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5cd20-673f-4bff-b628-12ca8e423964 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:30.996165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abf3ac-ffba-4bc6-b17e-39c418b56920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:31.008890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-c9abf3ac-ffba-4bc6-b17e-39c418b56920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:39:31.010910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 184/370] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:31.019924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf3ac-ffba-4bc6-b17e-39c418b56920 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:31.033068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31a78-9321-43c1-a8f7-33b4ffcb73bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:31.033780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31a78-9321-43c1-a8f7-33b4ffcb73bc None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:31.034100 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31a78-9321-43c1-a8f7-33b4ffcb73bc None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:31.034374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31a78-9321-43c1-a8f7-33b4ffcb73bc None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:31.035153 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c31a78-9321-43c1-a8f7-33b4ffcb73bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:31.035465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c31a78-9321-43c1-a8f7-33b4ffcb73bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:31.036911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c31a78-9321-43c1-a8f7-33b4ffcb73bc None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:31.046739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 187/371] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:31.053360 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31a78-9321-43c1-a8f7-33b4ffcb73bc None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:31.202903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abf3ac-ffba-4bc6-b17e-39c418b56920 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:31.226342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31a78-9321-43c1-a8f7-33b4ffcb73bc None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:31.261892 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96eed-7d1b-4f9c-8755-2d1f1b0128c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:31.263042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96eed-7d1b-4f9c-8755-2d1f1b0128c6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:31.263516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96eed-7d1b-4f9c-8755-2d1f1b0128c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:31.263984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96eed-7d1b-4f9c-8755-2d1f1b0128c6 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:31.266035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b96eed-7d1b-4f9c-8755-2d1f1b0128c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:31.266575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b96eed-7d1b-4f9c-8755-2d1f1b0128c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:31.269593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b96eed-7d1b-4f9c-8755-2d1f1b0128c6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:31.289986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 185/372] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:31.294813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96eed-7d1b-4f9c-8755-2d1f1b0128c6 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:31.297570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efa0f4-6350-4c78-9391-726953fd5c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:31.298630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efa0f4-6350-4c78-9391-726953fd5c7d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:31.299099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efa0f4-6350-4c78-9391-726953fd5c7d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:31.299568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efa0f4-6350-4c78-9391-726953fd5c7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:31.436022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efa0f4-6350-4c78-9391-726953fd5c7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:31.439233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efa0f4-6350-4c78-9391-726953fd5c7d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:31.482071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96eed-7d1b-4f9c-8755-2d1f1b0128c6 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:31.546578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0c4e6-6dab-4510-b664-f46036b19df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:31.548488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c4e6-6dab-4510-b664-f46036b19df9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:31.549163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c4e6-6dab-4510-b664-f46036b19df9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:31.550242 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c4e6-6dab-4510-b664-f46036b19df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:31.646119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 188/373] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:39:31.660997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efa0f4-6350-4c78-9391-726953fd5c7d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:31.767762 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0c4e6-6dab-4510-b664-f46036b19df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:31.770460 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0c4e6-6dab-4510-b664-f46036b19df9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:31.878939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efa0f4-6350-4c78-9391-726953fd5c7d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:31.930749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf387be1-60ec-49bf-a722-a459519b6e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:31.931942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf387be1-60ec-49bf-a722-a459519b6e2b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:31.932588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf387be1-60ec-49bf-a722-a459519b6e2b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:31.933029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf387be1-60ec-49bf-a722-a459519b6e2b None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:31.940915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf387be1-60ec-49bf-a722-a459519b6e2b None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:31.942649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf387be1-60ec-49bf-a722-a459519b6e2b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:31.944635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 189/374] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:31 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:31.953377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf387be1-60ec-49bf-a722-a459519b6e2b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:32.021486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 186/375] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:32.028400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0c4e6-6dab-4510-b664-f46036b19df9 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:32.242320 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf387be1-60ec-49bf-a722-a459519b6e2b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:32.375782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872853-4b47-456e-9d93-9610057c74dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:32.377282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872853-4b47-456e-9d93-9610057c74dd None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:32.377645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872853-4b47-456e-9d93-9610057c74dd None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:32.378098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872853-4b47-456e-9d93-9610057c74dd None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:32.381480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872853-4b47-456e-9d93-9610057c74dd None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:32.384253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872853-4b47-456e-9d93-9610057c74dd None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:32.388045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 190/376] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:31 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:32.396003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872853-4b47-456e-9d93-9610057c74dd None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:32.400704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0c4e6-6dab-4510-b664-f46036b19df9 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:32.460403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e55ff6-4c83-4d16-bb22-c1d3e6875cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:32.462954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55ff6-4c83-4d16-bb22-c1d3e6875cfc None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:32.464260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55ff6-4c83-4d16-bb22-c1d3e6875cfc None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:32.465029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55ff6-4c83-4d16-bb22-c1d3e6875cfc None admin] PATH_INFO: `/v3/projects/9df87fda527d419183d70b258d3b9b6b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:32.468575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e55ff6-4c83-4d16-bb22-c1d3e6875cfc None admin] RBAC: Authorizing `identity:get_project(project_id=9df87fda527d419183d70b258d3b9b6b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:32.471207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e55ff6-4c83-4d16-bb22-c1d3e6875cfc None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:32.473742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 187/377] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:32 2022] GET /identity/v3/projects/9df87fda527d419183d70b258d3b9b6b => generated 344 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:32.495243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e55ff6-4c83-4d16-bb22-c1d3e6875cfc None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:32.588898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872853-4b47-456e-9d93-9610057c74dd None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:32.634076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990290-5226-4998-9c19-28ff481ea8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:32.634685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990290-5226-4998-9c19-28ff481ea8ac None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:32.634969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990290-5226-4998-9c19-28ff481ea8ac None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:32.635245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990290-5226-4998-9c19-28ff481ea8ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:32.636103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990290-5226-4998-9c19-28ff481ea8ac None admin] RBAC: Adding query filter params (group.id=bf0bd7afe02c413585f98edb81d4ffac, role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=2d0172f0deac4b64babafdb092e05fd8) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:32.636419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990290-5226-4998-9c19-28ff481ea8ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:32.637957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1990290-5226-4998-9c19-28ff481ea8ac None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:32.651192 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 191/378] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:32 2022] GET /identity/v3/role_assignments?group.id=bf0bd7afe02c413585f98edb81d4ffac&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:32.687505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e55ff6-4c83-4d16-bb22-c1d3e6875cfc None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:32.761745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b9cab-976f-4ab5-a9c3-15a4523a822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:32.763228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b9cab-976f-4ab5-a9c3-15a4523a822e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:32.763740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b9cab-976f-4ab5-a9c3-15a4523a822e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:32.764215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b9cab-976f-4ab5-a9c3-15a4523a822e None admin] PATH_INFO: `/v3/groups/ceea5c167da948a2a432da58bbf76cd4` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:32.777855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b9cab-976f-4ab5-a9c3-15a4523a822e None admin] RBAC: Authorizing `identity:get_group(group_id=ceea5c167da948a2a432da58bbf76cd4)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:32.780724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b9cab-976f-4ab5-a9c3-15a4523a822e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:32.783892 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 188/379] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:32 2022] GET /identity/v3/groups/ceea5c167da948a2a432da58bbf76cd4 => generated 229 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:32.791796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990290-5226-4998-9c19-28ff481ea8ac None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:32.955907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990290-5226-4998-9c19-28ff481ea8ac None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:33.003013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd4473-636c-4214-858b-13225ea7bdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:33.003700 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd4473-636c-4214-858b-13225ea7bdf9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:33.003981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd4473-636c-4214-858b-13225ea7bdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:33.004248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd4473-636c-4214-858b-13225ea7bdf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:33.005098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd4473-636c-4214-858b-13225ea7bdf9 None admin] RBAC: Adding query filter params (group.id=ceea5c167da948a2a432da58bbf76cd4, role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=9df87fda527d419183d70b258d3b9b6b) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:33.005407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd4473-636c-4214-858b-13225ea7bdf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:33.006951 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd4473-636c-4214-858b-13225ea7bdf9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:33.019427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 192/380] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:32 2022] GET /identity/v3/role_assignments?group.id=ceea5c167da948a2a432da58bbf76cd4&scope.project.id=9df87fda527d419183d70b258d3b9b6b&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:33.506856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32c83-945d-4abf-a092-ba76a994a34e None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:33.507433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32c83-945d-4abf-a092-ba76a994a34e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:33.507433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32c83-945d-4abf-a092-ba76a994a34e None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:33.510150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 189/381] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:33.516448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd770e67-2b17-4c7c-9474-8f0652903d7b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:33.516970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd770e67-2b17-4c7c-9474-8f0652903d7b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:33.517074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd770e67-2b17-4c7c-9474-8f0652903d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:33.536260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-cd770e67-2b17-4c7c-9474-8f0652903d7b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:33.537479 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-cd770e67-2b17-4c7c-9474-8f0652903d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:33.628370 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 193/382] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:33.650725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32c83-945d-4abf-a092-ba76a994a34e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:33.766338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32c83-945d-4abf-a092-ba76a994a34e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:33.804315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a46796-5477-497a-af0e-118295e9b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:33.805137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a46796-5477-497a-af0e-118295e9b762 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:33.805449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a46796-5477-497a-af0e-118295e9b762 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:33.805731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a46796-5477-497a-af0e-118295e9b762 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:33.817897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a46796-5477-497a-af0e-118295e9b762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:33.825179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b3a46796-5477-497a-af0e-118295e9b762 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:33.834163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 190/383] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:33.835680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd770e67-2b17-4c7c-9474-8f0652903d7b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:33.960438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1b72-3f65-4d39-b361-3029652ad4fe None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:33.960810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1b72-3f65-4d39-b361-3029652ad4fe None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:33.961005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1b72-3f65-4d39-b361-3029652ad4fe None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:33.964523 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 191/384] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:33.969051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984500b-0768-4d6e-9814-16a02f6f6499 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:33.969340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984500b-0768-4d6e-9814-16a02f6f6499 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:33.969622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984500b-0768-4d6e-9814-16a02f6f6499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.000304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-8984500b-0768-4d6e-9814-16a02f6f6499 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:34.001534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-8984500b-0768-4d6e-9814-16a02f6f6499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:34.004107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd770e67-2b17-4c7c-9474-8f0652903d7b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:34.039631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e395c-6227-4b09-b35c-6463f7715266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:34.040928 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e395c-6227-4b09-b35c-6463f7715266 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.041303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e395c-6227-4b09-b35c-6463f7715266 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.041577 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e395c-6227-4b09-b35c-6463f7715266 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.042371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e395c-6227-4b09-b35c-6463f7715266 None admin] RBAC: Adding query filter params (name=member) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:34.042675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e395c-6227-4b09-b35c-6463f7715266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:34.044073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e395c-6227-4b09-b35c-6463f7715266 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:34.053368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 194/385] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:34.072954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e395c-6227-4b09-b35c-6463f7715266 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:34.090306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 192/386] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:34.121828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984500b-0768-4d6e-9814-16a02f6f6499 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:34.193761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e395c-6227-4b09-b35c-6463f7715266 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:34.232181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf809ee3-8deb-463f-9254-7f30fc493ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:34.233251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf809ee3-8deb-463f-9254-7f30fc493ad0 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.233533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf809ee3-8deb-463f-9254-7f30fc493ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.233801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf809ee3-8deb-463f-9254-7f30fc493ad0 None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.235103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf809ee3-8deb-463f-9254-7f30fc493ad0 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:34.235689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984500b-0768-4d6e-9814-16a02f6f6499 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:34.236586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf809ee3-8deb-463f-9254-7f30fc493ad0 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:34.238947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 195/387] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:34 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:34.259182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf809ee3-8deb-463f-9254-7f30fc493ad0 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:34.279943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb2540-6d61-4fd9-ab51-5a935da96107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:34.280784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb2540-6d61-4fd9-ab51-5a935da96107 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.281067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb2540-6d61-4fd9-ab51-5a935da96107 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.281348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb2540-6d61-4fd9-ab51-5a935da96107 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.306559 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb2540-6d61-4fd9-ab51-5a935da96107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:34.318676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-c8eb2540-6d61-4fd9-ab51-5a935da96107 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:34.320405 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 193/388] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:34.327854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb2540-6d61-4fd9-ab51-5a935da96107 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:34.480292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb2540-6d61-4fd9-ab51-5a935da96107 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:34.500400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf809ee3-8deb-463f-9254-7f30fc493ad0 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:34.531212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906b4cc-86aa-46f0-b23f-b7475c16b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:34.532041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906b4cc-86aa-46f0-b23f-b7475c16b236 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.532304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906b4cc-86aa-46f0-b23f-b7475c16b236 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.532538 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906b4cc-86aa-46f0-b23f-b7475c16b236 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.533351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906b4cc-86aa-46f0-b23f-b7475c16b236 None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:34.533659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906b4cc-86aa-46f0-b23f-b7475c16b236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:34.535676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906b4cc-86aa-46f0-b23f-b7475c16b236 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:34.547438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 194/389] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:34.555673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906b4cc-86aa-46f0-b23f-b7475c16b236 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:34.578790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035829a-a17c-4e35-8975-a91a7a2a33ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:34.579767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035829a-a17c-4e35-8975-a91a7a2a33ed None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.580002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035829a-a17c-4e35-8975-a91a7a2a33ed None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.580224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035829a-a17c-4e35-8975-a91a7a2a33ed None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.581557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035829a-a17c-4e35-8975-a91a7a2a33ed None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:34.585651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035829a-a17c-4e35-8975-a91a7a2a33ed None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:34.588151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 196/390] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:34 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:34.611363 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035829a-a17c-4e35-8975-a91a7a2a33ed None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:34.676485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906b4cc-86aa-46f0-b23f-b7475c16b236 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:34.713371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4baf74-1c25-4e66-b743-a20fb416f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:34.714348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4baf74-1c25-4e66-b743-a20fb416f3fb None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.714628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4baf74-1c25-4e66-b743-a20fb416f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.714901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4baf74-1c25-4e66-b743-a20fb416f3fb None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.716186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4baf74-1c25-4e66-b743-a20fb416f3fb None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:34.717686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4baf74-1c25-4e66-b743-a20fb416f3fb None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:34.719610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 195/391] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:34 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:34.725673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4baf74-1c25-4e66-b743-a20fb416f3fb None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:34.846258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035829a-a17c-4e35-8975-a91a7a2a33ed None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:34.882772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4baf74-1c25-4e66-b743-a20fb416f3fb None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:34.905569 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad35e0-3879-4a6d-904e-3408477a79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:34.906974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad35e0-3879-4a6d-904e-3408477a79f8 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.907593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad35e0-3879-4a6d-904e-3408477a79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.908269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad35e0-3879-4a6d-904e-3408477a79f8 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/groups/bf0bd7afe02c413585f98edb81d4ffac/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.912737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad35e0-3879-4a6d-904e-3408477a79f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b, group_id=bf0bd7afe02c413585f98edb81d4ffac, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:34.915995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad35e0-3879-4a6d-904e-3408477a79f8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:34.927004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac58af5-8639-4e8e-92dd-be322f8aa60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:34.928098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58af5-8639-4e8e-92dd-be322f8aa60c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.928640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58af5-8639-4e8e-92dd-be322f8aa60c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.928844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58af5-8639-4e8e-92dd-be322f8aa60c None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.930345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac58af5-8639-4e8e-92dd-be322f8aa60c None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:34.936191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac58af5-8639-4e8e-92dd-be322f8aa60c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:34.938089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 196/392] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:34 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:34.939372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e164-539f-42c9-8391-c9fc633bbfe0 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.939654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e164-539f-42c9-8391-c9fc633bbfe0 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.939928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e164-539f-42c9-8391-c9fc633bbfe0 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.948914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 197/393] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Mar 22 19:39:34 2022] PUT /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/groups/bf0bd7afe02c413585f98edb81d4ffac/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:39:34.949915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad35e0-3879-4a6d-904e-3408477a79f8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:34.950254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 197/394] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:34.952078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c3b3-9c78-4b6f-a604-8ab1a4282799 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:34.952369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c3b3-9c78-4b6f-a604-8ab1a4282799 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:34.952636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4c3b3-9c78-4b6f-a604-8ab1a4282799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:34.996803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-34e4c3b3-9c78-4b6f-a604-8ab1a4282799 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:34.998840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-34e4c3b3-9c78-4b6f-a604-8ab1a4282799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:35.138344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 198/395] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:35.157602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad35e0-3879-4a6d-904e-3408477a79f8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:35.171601 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c3b3-9c78-4b6f-a604-8ab1a4282799 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:35.225500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf14df-0551-4380-a7e1-e7c6c6ac9b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:35.227179 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf14df-0551-4380-a7e1-e7c6c6ac9b79 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:35.227842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf14df-0551-4380-a7e1-e7c6c6ac9b79 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:35.228241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf14df-0551-4380-a7e1-e7c6c6ac9b79 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8/groups/bf0bd7afe02c413585f98edb81d4ffac/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:35.231641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf14df-0551-4380-a7e1-e7c6c6ac9b79 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d0172f0deac4b64babafdb092e05fd8, group_id=bf0bd7afe02c413585f98edb81d4ffac, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:35.234280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf14df-0551-4380-a7e1-e7c6c6ac9b79 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:35.261969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 198/396] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Mar 22 19:39:34 2022] PUT /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8/groups/bf0bd7afe02c413585f98edb81d4ffac/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:39:35.351794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4c3b3-9c78-4b6f-a604-8ab1a4282799 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:35.402069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd327271-b9b9-4157-8d1b-405ce18ceaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:35.403274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd327271-b9b9-4157-8d1b-405ce18ceaf0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:35.403755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd327271-b9b9-4157-8d1b-405ce18ceaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:35.404223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd327271-b9b9-4157-8d1b-405ce18ceaf0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:35.427777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd327271-b9b9-4157-8d1b-405ce18ceaf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:35.437892 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-fd327271-b9b9-4157-8d1b-405ce18ceaf0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:39:35.442848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 199/397] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:39:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:35.447347 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf14df-0551-4380-a7e1-e7c6c6ac9b79 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:35.605364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf14df-0551-4380-a7e1-e7c6c6ac9b79 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:35.652483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856bec8-57b6-4bd8-91c0-08e0dd703496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:35.653078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856bec8-57b6-4bd8-91c0-08e0dd703496 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:35.653354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856bec8-57b6-4bd8-91c0-08e0dd703496 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:35.653632 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856bec8-57b6-4bd8-91c0-08e0dd703496 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:35.654437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856bec8-57b6-4bd8-91c0-08e0dd703496 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:35.654762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856bec8-57b6-4bd8-91c0-08e0dd703496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:35.656188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856bec8-57b6-4bd8-91c0-08e0dd703496 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:35.670333 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 199/398] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:35.679047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd327271-b9b9-4157-8d1b-405ce18ceaf0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:35.912726 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd327271-b9b9-4157-8d1b-405ce18ceaf0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:36.001066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78527139-f56e-4ab3-ac5c-860ee9ab465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:36.002022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78527139-f56e-4ab3-ac5c-860ee9ab465e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:36.002303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78527139-f56e-4ab3-ac5c-860ee9ab465e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:36.002576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78527139-f56e-4ab3-ac5c-860ee9ab465e None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:36.004187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78527139-f56e-4ab3-ac5c-860ee9ab465e None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:36.006506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78527139-f56e-4ab3-ac5c-860ee9ab465e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:36.015468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 200/399] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:35 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:36.020595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856bec8-57b6-4bd8-91c0-08e0dd703496 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:36.185130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856bec8-57b6-4bd8-91c0-08e0dd703496 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:36.233267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d28e5-a156-4b50-98cf-783d4ab718d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:36.234191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d28e5-a156-4b50-98cf-783d4ab718d2 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:36.234472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d28e5-a156-4b50-98cf-783d4ab718d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:36.234746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d28e5-a156-4b50-98cf-783d4ab718d2 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:36.238854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d28e5-a156-4b50-98cf-783d4ab718d2 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:36.240362 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d28e5-a156-4b50-98cf-783d4ab718d2 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:36.242434 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 200/400] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:36 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:36.249005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78527139-f56e-4ab3-ac5c-860ee9ab465e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:36.306086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b5c13-d599-4787-b753-65e88a24fb7b None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:36.306433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b5c13-d599-4787-b753-65e88a24fb7b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:36.306653 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b5c13-d599-4787-b753-65e88a24fb7b None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:36.308893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 201/401] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:36.316506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e16a1-756f-4ed9-a607-387dedf63359 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:36.316887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e16a1-756f-4ed9-a607-387dedf63359 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:36.317173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e16a1-756f-4ed9-a607-387dedf63359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:36.337902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-706e16a1-756f-4ed9-a607-387dedf63359 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:36.340533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-706e16a1-756f-4ed9-a607-387dedf63359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:36.465733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78527139-f56e-4ab3-ac5c-860ee9ab465e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:36.505888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098014d-3b4f-439f-bf6c-91a13a448867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:36.506838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098014d-3b4f-439f-bf6c-91a13a448867 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:36.507118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098014d-3b4f-439f-bf6c-91a13a448867 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:36.507388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098014d-3b4f-439f-bf6c-91a13a448867 None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/groups/bf0bd7afe02c413585f98edb81d4ffac/roles/3dae28c0ed754e34b0024bbb40d02fb7` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:36.509840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098014d-3b4f-439f-bf6c-91a13a448867 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b, group_id=bf0bd7afe02c413585f98edb81d4ffac, role_id=3dae28c0ed754e34b0024bbb40d02fb7)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:36.511343 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098014d-3b4f-439f-bf6c-91a13a448867 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:36.527833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 202/402] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:36.537041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 201/403] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Mar 22 19:39:36 2022] PUT /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b/groups/bf0bd7afe02c413585f98edb81d4ffac/roles/3dae28c0ed754e34b0024bbb40d02fb7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:39:36.576916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e16a1-756f-4ed9-a607-387dedf63359 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:36.789385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e16a1-756f-4ed9-a607-387dedf63359 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:36.885154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22363f8-79f4-44d8-a322-b2d022e64ed5 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:36.886004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22363f8-79f4-44d8-a322-b2d022e64ed5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:36.886004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22363f8-79f4-44d8-a322-b2d022e64ed5 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:36.887923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 202/404] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:36.894404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dca3a-c01d-4ab0-8a15-09ad1c7c3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:36.895926 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dca3a-c01d-4ab0-8a15-09ad1c7c3205 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:36.896429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dca3a-c01d-4ab0-8a15-09ad1c7c3205 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:36.896910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dca3a-c01d-4ab0-8a15-09ad1c7c3205 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:36.900307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d44600-ccf6-4201-9071-5d35eb6290fc None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:36.900669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d44600-ccf6-4201-9071-5d35eb6290fc None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:36.900903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d44600-ccf6-4201-9071-5d35eb6290fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:36.917608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dca3a-c01d-4ab0-8a15-09ad1c7c3205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:36.921383 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-38d44600-ccf6-4201-9071-5d35eb6290fc None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:36.922615 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-38d44600-ccf6-4201-9071-5d35eb6290fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:36.932203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a25dca3a-c01d-4ab0-8a15-09ad1c7c3205 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:39:36.934828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 203/405] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:39:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:36.940871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dca3a-c01d-4ab0-8a15-09ad1c7c3205 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:37.008913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 203/406] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:37.033441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d44600-ccf6-4201-9071-5d35eb6290fc None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:37.072033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dca3a-c01d-4ab0-8a15-09ad1c7c3205 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:37.111301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cedfe-5a0c-4a3c-bb83-2f009a7d2232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:37.112105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cedfe-5a0c-4a3c-bb83-2f009a7d2232 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:37.112386 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cedfe-5a0c-4a3c-bb83-2f009a7d2232 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:37.112660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cedfe-5a0c-4a3c-bb83-2f009a7d2232 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:37.113425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cedfe-5a0c-4a3c-bb83-2f009a7d2232 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:37.113732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cedfe-5a0c-4a3c-bb83-2f009a7d2232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:37.115769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cedfe-5a0c-4a3c-bb83-2f009a7d2232 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:37.128112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 204/407] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:37.134443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cedfe-5a0c-4a3c-bb83-2f009a7d2232 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:37.252234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cedfe-5a0c-4a3c-bb83-2f009a7d2232 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:37.257700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d44600-ccf6-4201-9071-5d35eb6290fc None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:37.291234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d5aa9-a853-4d00-8311-0996e59d7dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:37.292141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d5aa9-a853-4d00-8311-0996e59d7dc7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:37.292954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d5aa9-a853-4d00-8311-0996e59d7dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:37.293232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d5aa9-a853-4d00-8311-0996e59d7dc7 None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:37.294845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d5aa9-a853-4d00-8311-0996e59d7dc7 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:37.296558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d5aa9-a853-4d00-8311-0996e59d7dc7 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:37.298972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 205/408] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:37 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:37.305779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d5aa9-a853-4d00-8311-0996e59d7dc7 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:37.383937 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b5e7c-d9af-47b3-9d92-529533a5dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:37.385155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b5e7c-d9af-47b3-9d92-529533a5dec4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:37.385695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b5e7c-d9af-47b3-9d92-529533a5dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:37.386193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b5e7c-d9af-47b3-9d92-529533a5dec4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:37.419044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b5e7c-d9af-47b3-9d92-529533a5dec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:37.433968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d5aa9-a853-4d00-8311-0996e59d7dc7 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:37.435114 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-232b5e7c-d9af-47b3-9d92-529533a5dec4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:39:37.437090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 204/409] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:37.442848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b5e7c-d9af-47b3-9d92-529533a5dec4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:37.471358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a464-0e0c-4b22-868f-78cdd29a12fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:37.472262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a464-0e0c-4b22-868f-78cdd29a12fb None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:37.472544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a464-0e0c-4b22-868f-78cdd29a12fb None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:37.472822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a464-0e0c-4b22-868f-78cdd29a12fb None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:37.474909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71a464-0e0c-4b22-868f-78cdd29a12fb None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:37.476599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71a464-0e0c-4b22-868f-78cdd29a12fb None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:37.479406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 206/410] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:37 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:37.485461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a464-0e0c-4b22-868f-78cdd29a12fb None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:37.632534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b5e7c-d9af-47b3-9d92-529533a5dec4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:37.674101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb5e99-433a-41c0-86aa-5fcd8bb50060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:37.674721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb5e99-433a-41c0-86aa-5fcd8bb50060 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:37.675060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb5e99-433a-41c0-86aa-5fcd8bb50060 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:37.675340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb5e99-433a-41c0-86aa-5fcd8bb50060 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:37.676110 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb5e99-433a-41c0-86aa-5fcd8bb50060 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:37.676418 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb5e99-433a-41c0-86aa-5fcd8bb50060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:37.678501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb5e99-433a-41c0-86aa-5fcd8bb50060 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:37.688654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 205/411] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:37.695084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb5e99-433a-41c0-86aa-5fcd8bb50060 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:37.740516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71a464-0e0c-4b22-868f-78cdd29a12fb None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:37.819342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a67ca6-7e35-4eb0-aa6b-9cf8a300d166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:37.820276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a67ca6-7e35-4eb0-aa6b-9cf8a300d166 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:37.820559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a67ca6-7e35-4eb0-aa6b-9cf8a300d166 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:37.820832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a67ca6-7e35-4eb0-aa6b-9cf8a300d166 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8/groups/bf0bd7afe02c413585f98edb81d4ffac/roles/3dae28c0ed754e34b0024bbb40d02fb7` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:37.826913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a67ca6-7e35-4eb0-aa6b-9cf8a300d166 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d0172f0deac4b64babafdb092e05fd8, group_id=bf0bd7afe02c413585f98edb81d4ffac, role_id=3dae28c0ed754e34b0024bbb40d02fb7)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:37.828402 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a67ca6-7e35-4eb0-aa6b-9cf8a300d166 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:37.860221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb5e99-433a-41c0-86aa-5fcd8bb50060 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:37.867919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 207/412] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Mar 22 19:39:37 2022] PUT /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8/groups/bf0bd7afe02c413585f98edb81d4ffac/roles/3dae28c0ed754e34b0024bbb40d02fb7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:39:37.935174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfff06f-4e08-4c3a-a9bc-434dce9c1f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:37.936875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfff06f-4e08-4c3a-a9bc-434dce9c1f6f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:37.937370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfff06f-4e08-4c3a-a9bc-434dce9c1f6f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:37.937844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfff06f-4e08-4c3a-a9bc-434dce9c1f6f None admin] PATH_INFO: `/v3/groups/ceea5c167da948a2a432da58bbf76cd4` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:37.942935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfff06f-4e08-4c3a-a9bc-434dce9c1f6f None admin] RBAC: Authorizing `identity:get_group(group_id=ceea5c167da948a2a432da58bbf76cd4)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:37.944821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfff06f-4e08-4c3a-a9bc-434dce9c1f6f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:37.947193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 206/413] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:37 2022] GET /identity/v3/groups/ceea5c167da948a2a432da58bbf76cd4 => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:37.953624 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a67ca6-7e35-4eb0-aa6b-9cf8a300d166 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:38.120671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a67ca6-7e35-4eb0-aa6b-9cf8a300d166 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:38.165774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0e1fa-e6dc-48af-a473-62f9e69fb63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:38.167121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0e1fa-e6dc-48af-a473-62f9e69fb63b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:38.167646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0e1fa-e6dc-48af-a473-62f9e69fb63b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:38.168119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0e1fa-e6dc-48af-a473-62f9e69fb63b None admin] PATH_INFO: `/v3/projects/9df87fda527d419183d70b258d3b9b6b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:38.174954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0e1fa-e6dc-48af-a473-62f9e69fb63b None admin] RBAC: Authorizing `identity:get_project(project_id=9df87fda527d419183d70b258d3b9b6b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:38.176815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0e1fa-e6dc-48af-a473-62f9e69fb63b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:38.179266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 208/414] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:37 2022] GET /identity/v3/projects/9df87fda527d419183d70b258d3b9b6b => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:38.184912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfff06f-4e08-4c3a-a9bc-434dce9c1f6f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:38.346610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfff06f-4e08-4c3a-a9bc-434dce9c1f6f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:38.424625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df12351-2f30-4006-96a6-9eccf5797b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:38.425973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df12351-2f30-4006-96a6-9eccf5797b54 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:38.426378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df12351-2f30-4006-96a6-9eccf5797b54 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:38.426763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df12351-2f30-4006-96a6-9eccf5797b54 None admin] PATH_INFO: `/v3/projects/9df87fda527d419183d70b258d3b9b6b/groups/ceea5c167da948a2a432da58bbf76cd4/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:38.436018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df12351-2f30-4006-96a6-9eccf5797b54 None admin] RBAC: Authorizing `identity:create_grant(project_id=9df87fda527d419183d70b258d3b9b6b, group_id=ceea5c167da948a2a432da58bbf76cd4, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:38.438642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df12351-2f30-4006-96a6-9eccf5797b54 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:38.474827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 207/415] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Mar 22 19:39:38 2022] PUT /identity/v3/projects/9df87fda527d419183d70b258d3b9b6b/groups/ceea5c167da948a2a432da58bbf76cd4/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:39:38.558599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2bac0-b17b-46b4-87e4-1cd304a27e79 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:38.559256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2bac0-b17b-46b4-87e4-1cd304a27e79 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:38.559736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2bac0-b17b-46b4-87e4-1cd304a27e79 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:38.562308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 209/416] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:38.568797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d362ebe-9731-4d1e-a01c-399bc43c5e7c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:38.569290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d362ebe-9731-4d1e-a01c-399bc43c5e7c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:38.569773 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d362ebe-9731-4d1e-a01c-399bc43c5e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:38.610670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6d362ebe-9731-4d1e-a01c-399bc43c5e7c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:38.612739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6d362ebe-9731-4d1e-a01c-399bc43c5e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:38.750472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 208/417] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:38.782010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2bac0-b17b-46b4-87e4-1cd304a27e79 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:39.057292 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2bac0-b17b-46b4-87e4-1cd304a27e79 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:39.106185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ea975-4e4e-4502-ac34-c3542cdc6308 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:39.107035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ea975-4e4e-4502-ac34-c3542cdc6308 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:39.107035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ea975-4e4e-4502-ac34-c3542cdc6308 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:39.110898 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 209/418] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:39.119894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72db4ce-9744-47bf-9f0d-2b5436833b47 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:39.120336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72db4ce-9744-47bf-9f0d-2b5436833b47 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:39.120835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72db4ce-9744-47bf-9f0d-2b5436833b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:39.132764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0fb18-4371-493b-a827-39e25c9a7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:39.137175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0fb18-4371-493b-a827-39e25c9a7c63 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:39.137175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0fb18-4371-493b-a827-39e25c9a7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:39.137555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0fb18-4371-493b-a827-39e25c9a7c63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:39.170375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e72db4ce-9744-47bf-9f0d-2b5436833b47 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:39.174768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e72db4ce-9744-47bf-9f0d-2b5436833b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:39.197499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0fb18-4371-493b-a827-39e25c9a7c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:39.222727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-75b0fb18-4371-493b-a827-39e25c9a7c63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:39.225536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 210/419] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:39.235529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0fb18-4371-493b-a827-39e25c9a7c63 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:39.350794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 210/420] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:39.400827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72db4ce-9744-47bf-9f0d-2b5436833b47 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:39.433144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0fb18-4371-493b-a827-39e25c9a7c63 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:39.477522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639316-608e-470b-a85b-834202505e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:39.478266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639316-608e-470b-a85b-834202505e31 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:39.478551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639316-608e-470b-a85b-834202505e31 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:39.478830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639316-608e-470b-a85b-834202505e31 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:39.479603 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639316-608e-470b-a85b-834202505e31 None admin] RBAC: Adding query filter params (name=member) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:39.479914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639316-608e-470b-a85b-834202505e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:39.481477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639316-608e-470b-a85b-834202505e31 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:39.498679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 211/421] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:39.504508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639316-608e-470b-a85b-834202505e31 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:39.613038 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72db4ce-9744-47bf-9f0d-2b5436833b47 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:39.691680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639316-608e-470b-a85b-834202505e31 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:39.718872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289cf2-1f2d-4a7e-903f-76b4837ebc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:39.719696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289cf2-1f2d-4a7e-903f-76b4837ebc85 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:39.719967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289cf2-1f2d-4a7e-903f-76b4837ebc85 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:39.720238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289cf2-1f2d-4a7e-903f-76b4837ebc85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:39.734001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc16440-fee3-4745-b1c9-d460d57f9be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:39.734668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc16440-fee3-4745-b1c9-d460d57f9be9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:39.734944 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc16440-fee3-4745-b1c9-d460d57f9be9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:39.735212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc16440-fee3-4745-b1c9-d460d57f9be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:39.742566 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37289cf2-1f2d-4a7e-903f-76b4837ebc85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:39.750353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-37289cf2-1f2d-4a7e-903f-76b4837ebc85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 22 19:39:39.751964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 211/422] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:39.757837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289cf2-1f2d-4a7e-903f-76b4837ebc85 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:39.885652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc16440-fee3-4745-b1c9-d460d57f9be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:39.887080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc16440-fee3-4745-b1c9-d460d57f9be9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:39.947534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289cf2-1f2d-4a7e-903f-76b4837ebc85 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:40.000011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead14a3-c0c9-4396-a0c1-99869e2a4696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:40.000573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead14a3-c0c9-4396-a0c1-99869e2a4696 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.000853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead14a3-c0c9-4396-a0c1-99869e2a4696 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.001123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead14a3-c0c9-4396-a0c1-99869e2a4696 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.001886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead14a3-c0c9-4396-a0c1-99869e2a4696 None admin] RBAC: Adding query filter params (name=member) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:40.002221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead14a3-c0c9-4396-a0c1-99869e2a4696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:40.003684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead14a3-c0c9-4396-a0c1-99869e2a4696 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:40.011185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 212/423] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:39:40.014085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304276bb-7dab-426a-a95a-d4836365290a None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.014885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304276bb-7dab-426a-a95a-d4836365290a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.015583 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304276bb-7dab-426a-a95a-d4836365290a None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.019254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 213/424] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:40.020985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304276bb-7dab-426a-a95a-d4836365290a None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:40.026756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 212/425] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:39:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:40.032504 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4694c5-04e9-4107-a1eb-01806cab5566 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.033001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4694c5-04e9-4107-a1eb-01806cab5566 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.033485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4694c5-04e9-4107-a1eb-01806cab5566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.065372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7c4694c5-04e9-4107-a1eb-01806cab5566 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:40.066494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7c4694c5-04e9-4107-a1eb-01806cab5566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:40.146061 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 213/426] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:40.146061 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4694c5-04e9-4107-a1eb-01806cab5566 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:40.156296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304276bb-7dab-426a-a95a-d4836365290a None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:40.211422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ec295-d205-4d2d-a1bd-24c2a9e01c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:40.213489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ec295-d205-4d2d-a1bd-24c2a9e01c3f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.214046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ec295-d205-4d2d-a1bd-24c2a9e01c3f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.214516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ec295-d205-4d2d-a1bd-24c2a9e01c3f None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.216023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ec295-d205-4d2d-a1bd-24c2a9e01c3f None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:40.217688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ec295-d205-4d2d-a1bd-24c2a9e01c3f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:40.220013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 214/427] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:40 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:40.221061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ec295-d205-4d2d-a1bd-24c2a9e01c3f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:40.249923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4694c5-04e9-4107-a1eb-01806cab5566 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:40.287830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65272adb-a6ae-4a64-99ef-c6af851f13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:40.288250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65272adb-a6ae-4a64-99ef-c6af851f13f9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.288539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65272adb-a6ae-4a64-99ef-c6af851f13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.288871 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65272adb-a6ae-4a64-99ef-c6af851f13f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.334865 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ec295-d205-4d2d-a1bd-24c2a9e01c3f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:40.366263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65272adb-a6ae-4a64-99ef-c6af851f13f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:40.367919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65272adb-a6ae-4a64-99ef-c6af851f13f9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:40.377895 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac4853-6346-4455-b6b7-8cfa42be60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:40.379166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac4853-6346-4455-b6b7-8cfa42be60f3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.379664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac4853-6346-4455-b6b7-8cfa42be60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.380139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac4853-6346-4455-b6b7-8cfa42be60f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.392683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac4853-6346-4455-b6b7-8cfa42be60f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:40.401349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-b3ac4853-6346-4455-b6b7-8cfa42be60f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:39:40.403029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 215/428] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:39:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:40.409180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac4853-6346-4455-b6b7-8cfa42be60f3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:40.481616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 214/429] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:40.482873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65272adb-a6ae-4a64-99ef-c6af851f13f9 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:40.518515 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac4853-6346-4455-b6b7-8cfa42be60f3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:40.554734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70bcb-e4c4-433e-a3ce-fad54aa58657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:40.556870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70bcb-e4c4-433e-a3ce-fad54aa58657 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.557417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70bcb-e4c4-433e-a3ce-fad54aa58657 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.557881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70bcb-e4c4-433e-a3ce-fad54aa58657 None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.559502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70bcb-e4c4-433e-a3ce-fad54aa58657 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:40.561237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70bcb-e4c4-433e-a3ce-fad54aa58657 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:40.563533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 216/430] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:40 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:40.564557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70bcb-e4c4-433e-a3ce-fad54aa58657 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:40.587568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65272adb-a6ae-4a64-99ef-c6af851f13f9 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:40.624483 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9f683-3dcf-4c2e-991b-49f428a49c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:40.625242 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9f683-3dcf-4c2e-991b-49f428a49c43 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.625527 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9f683-3dcf-4c2e-991b-49f428a49c43 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.625779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9f683-3dcf-4c2e-991b-49f428a49c43 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.626623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9f683-3dcf-4c2e-991b-49f428a49c43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:40.626935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9f683-3dcf-4c2e-991b-49f428a49c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:40.628358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9f683-3dcf-4c2e-991b-49f428a49c43 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:40.642309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 215/431] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:40.642309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9f683-3dcf-4c2e-991b-49f428a49c43 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:40.687307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70bcb-e4c4-433e-a3ce-fad54aa58657 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:40.735227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2f4ae-36fe-4932-89d9-2f0377601de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:40.736128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2f4ae-36fe-4932-89d9-2f0377601de6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.736420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2f4ae-36fe-4932-89d9-2f0377601de6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.736695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2f4ae-36fe-4932-89d9-2f0377601de6 None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.737976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2f4ae-36fe-4932-89d9-2f0377601de6 None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:40.739451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2f4ae-36fe-4932-89d9-2f0377601de6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:40.746045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 217/432] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:40 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:40.747307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2f4ae-36fe-4932-89d9-2f0377601de6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:40.776316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9f683-3dcf-4c2e-991b-49f428a49c43 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:40.823205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f71b-3247-458d-8e6d-ea023eee7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:40.824303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f71b-3247-458d-8e6d-ea023eee7f79 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:40.824812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f71b-3247-458d-8e6d-ea023eee7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:40.825284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f71b-3247-458d-8e6d-ea023eee7f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:40.826385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76f71b-3247-458d-8e6d-ea023eee7f79 None admin] RBAC: Adding query filter params (group.id=bf0bd7afe02c413585f98edb81d4ffac, role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:40.826908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76f71b-3247-458d-8e6d-ea023eee7f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:40.828653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76f71b-3247-458d-8e6d-ea023eee7f79 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:40.836217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 216/433] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:40 2022] GET /identity/v3/role_assignments?group.id=bf0bd7afe02c413585f98edb81d4ffac&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:40.837588 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f71b-3247-458d-8e6d-ea023eee7f79 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:40.912901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2f4ae-36fe-4932-89d9-2f0377601de6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:40.972272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f71b-3247-458d-8e6d-ea023eee7f79 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:41.000464 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d58f0d-a5f1-452f-a7a6-3ce9678f79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:41.001622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d58f0d-a5f1-452f-a7a6-3ce9678f79f8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:41.002147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d58f0d-a5f1-452f-a7a6-3ce9678f79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:41.002628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d58f0d-a5f1-452f-a7a6-3ce9678f79f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:41.029734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce405591-feb8-4c5d-8459-0cd9a21865f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:41.030663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce405591-feb8-4c5d-8459-0cd9a21865f6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:41.030942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce405591-feb8-4c5d-8459-0cd9a21865f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:41.031214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce405591-feb8-4c5d-8459-0cd9a21865f6 None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:41.034264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce405591-feb8-4c5d-8459-0cd9a21865f6 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:41.036033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce405591-feb8-4c5d-8459-0cd9a21865f6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:41.037862 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 217/434] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:40 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:41.048717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce405591-feb8-4c5d-8459-0cd9a21865f6 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:41.126630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d58f0d-a5f1-452f-a7a6-3ce9678f79f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:41.130224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d58f0d-a5f1-452f-a7a6-3ce9678f79f8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:41.260770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 218/435] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:41.269173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d58f0d-a5f1-452f-a7a6-3ce9678f79f8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:41.298110 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce405591-feb8-4c5d-8459-0cd9a21865f6 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:41.381316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36566a7-a25f-40b5-a2fe-b562b605a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:41.386189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36566a7-a25f-40b5-a2fe-b562b605a822 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:41.386855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36566a7-a25f-40b5-a2fe-b562b605a822 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:41.387434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36566a7-a25f-40b5-a2fe-b562b605a822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:41.390242 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36566a7-a25f-40b5-a2fe-b562b605a822 None admin] RBAC: Adding query filter params (group.id=bf0bd7afe02c413585f98edb81d4ffac, role.id=a50cc38d78674f6eaffc44a0a26ed453, scope.project.id=2d0172f0deac4b64babafdb092e05fd8) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:41.391473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36566a7-a25f-40b5-a2fe-b562b605a822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:41.395321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36566a7-a25f-40b5-a2fe-b562b605a822 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:41.410781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 218/436] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:41 2022] GET /identity/v3/role_assignments?group.id=bf0bd7afe02c413585f98edb81d4ffac&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=a50cc38d78674f6eaffc44a0a26ed453 => generated 611 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:41.426687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d58f0d-a5f1-452f-a7a6-3ce9678f79f8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:41.477048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91e6a7-2f82-4342-810c-311c23ec46be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:41.478452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e6a7-2f82-4342-810c-311c23ec46be None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:41.478813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e6a7-2f82-4342-810c-311c23ec46be None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:41.479091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e6a7-2f82-4342-810c-311c23ec46be None admin] PATH_INFO: `/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:41.480576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91e6a7-2f82-4342-810c-311c23ec46be None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d3124dd1b4cf7a1ef6e218400ef5b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:41.482158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91e6a7-2f82-4342-810c-311c23ec46be None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:41.485796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 219/437] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:41 2022] GET /identity/v3/projects/6b4d3124dd1b4cf7a1ef6e218400ef5b => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:41.491623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36566a7-a25f-40b5-a2fe-b562b605a822 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:41.593041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c14d-3bd8-4b49-986e-cd97f4be5e07 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:41.593399 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c14d-3bd8-4b49-986e-cd97f4be5e07 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:41.593582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c14d-3bd8-4b49-986e-cd97f4be5e07 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:41.596441 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 220/438] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:41.608790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7532b68-113d-47fc-b3ae-717eeec36bbd None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:41.609157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7532b68-113d-47fc-b3ae-717eeec36bbd None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:41.609354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7532b68-113d-47fc-b3ae-717eeec36bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:41.631714 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36566a7-a25f-40b5-a2fe-b562b605a822 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:41.637024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-a7532b68-113d-47fc-b3ae-717eeec36bbd None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:41.639853 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a7532b68-113d-47fc-b3ae-717eeec36bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:41.681284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff954-da91-4c83-9996-2ed73f87d16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:41.682910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff954-da91-4c83-9996-2ed73f87d16c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:41.683640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff954-da91-4c83-9996-2ed73f87d16c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:41.684571 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff954-da91-4c83-9996-2ed73f87d16c None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:41.686820 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ff954-da91-4c83-9996-2ed73f87d16c None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:41.689105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ff954-da91-4c83-9996-2ed73f87d16c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:41.691807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 219/439] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:41 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:41.698628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff954-da91-4c83-9996-2ed73f87d16c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:41.753820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 221/440] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:41.787734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7532b68-113d-47fc-b3ae-717eeec36bbd None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:41.851329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff954-da91-4c83-9996-2ed73f87d16c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:41.897271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfeab3-f1c7-45a1-9f7e-3fabe52c94e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:41.898063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfeab3-f1c7-45a1-9f7e-3fabe52c94e1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:41.898344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfeab3-f1c7-45a1-9f7e-3fabe52c94e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:41.898632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfeab3-f1c7-45a1-9f7e-3fabe52c94e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:41.899972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfeab3-f1c7-45a1-9f7e-3fabe52c94e1 None admin] RBAC: Adding query filter params (group.id=bf0bd7afe02c413585f98edb81d4ffac, role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:41.900451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfeab3-f1c7-45a1-9f7e-3fabe52c94e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:41.901973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfeab3-f1c7-45a1-9f7e-3fabe52c94e1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:41.910377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 220/441] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:41 2022] GET /identity/v3/role_assignments?group.id=bf0bd7afe02c413585f98edb81d4ffac&scope.project.id=6b4d3124dd1b4cf7a1ef6e218400ef5b&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:41.955031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7532b68-113d-47fc-b3ae-717eeec36bbd None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:41.996444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ffb93-7b77-4408-96bb-56850b0ecccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:41.997290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ffb93-7b77-4408-96bb-56850b0ecccc None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:41.997568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ffb93-7b77-4408-96bb-56850b0ecccc None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:41.997794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ffb93-7b77-4408-96bb-56850b0ecccc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.011160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ffb93-7b77-4408-96bb-56850b0ecccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:42.018794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-211ffb93-7b77-4408-96bb-56850b0ecccc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:39:42.020378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 222/442] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:39:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:42.026828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfeab3-f1c7-45a1-9f7e-3fabe52c94e1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:42.098315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c9194-0b7b-461d-9398-7232abaf1052 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:42.098998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c9194-0b7b-461d-9398-7232abaf1052 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:42.099437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c9194-0b7b-461d-9398-7232abaf1052 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.101509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 223/443] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:42.109865 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50492be3-cb30-46dd-841a-31101722be2e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:42.110181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50492be3-cb30-46dd-841a-31101722be2e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:42.110466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50492be3-cb30-46dd-841a-31101722be2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.130856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-50492be3-cb30-46dd-841a-31101722be2e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:42.132093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-50492be3-cb30-46dd-841a-31101722be2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:42.155414 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfeab3-f1c7-45a1-9f7e-3fabe52c94e1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:42.199913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c7cd-7465-476a-88b5-c6a2a7a75756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:42.200598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c7cd-7465-476a-88b5-c6a2a7a75756 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:42.200872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c7cd-7465-476a-88b5-c6a2a7a75756 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:42.204178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c7cd-7465-476a-88b5-c6a2a7a75756 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.204178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0c7cd-7465-476a-88b5-c6a2a7a75756 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:42.204178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0c7cd-7465-476a-88b5-c6a2a7a75756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:42.204178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0c7cd-7465-476a-88b5-c6a2a7a75756 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:42.213977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 221/444] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:42.219341 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c7cd-7465-476a-88b5-c6a2a7a75756 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:42.222408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 224/445] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:42.246532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50492be3-cb30-46dd-841a-31101722be2e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:42.369309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c7cd-7465-476a-88b5-c6a2a7a75756 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:42.370308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50492be3-cb30-46dd-841a-31101722be2e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:42.408447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf77ee-1a24-4095-b818-f1f964622f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:42.409104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf77ee-1a24-4095-b818-f1f964622f65 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:42.409489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf77ee-1a24-4095-b818-f1f964622f65 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:42.409772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf77ee-1a24-4095-b818-f1f964622f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.412422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c43e7-ac05-475d-a3e4-bcdb6e3f0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:42.412422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c43e7-ac05-475d-a3e4-bcdb6e3f0532 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:42.412422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c43e7-ac05-475d-a3e4-bcdb6e3f0532 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:42.412422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c43e7-ac05-475d-a3e4-bcdb6e3f0532 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.427133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c43e7-ac05-475d-a3e4-bcdb6e3f0532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:42.434784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-517c43e7-ac05-475d-a3e4-bcdb6e3f0532 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:39:42.441094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 225/446] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:42.442443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c43e7-ac05-475d-a3e4-bcdb6e3f0532 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:42.497457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf77ee-1a24-4095-b818-f1f964622f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:42.499004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf77ee-1a24-4095-b818-f1f964622f65 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:42.589042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c43e7-ac05-475d-a3e4-bcdb6e3f0532 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:42.619096 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 222/447] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:39:42.625240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf77ee-1a24-4095-b818-f1f964622f65 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:42.628492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb8afd-3ead-470a-8626-d1ebbbb6c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:42.629249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb8afd-3ead-470a-8626-d1ebbbb6c931 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:42.629533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb8afd-3ead-470a-8626-d1ebbbb6c931 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:42.629812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb8afd-3ead-470a-8626-d1ebbbb6c931 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.630644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb8afd-3ead-470a-8626-d1ebbbb6c931 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:42.630957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb8afd-3ead-470a-8626-d1ebbbb6c931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:42.632408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb8afd-3ead-470a-8626-d1ebbbb6c931 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:42.642782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 226/448] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:42.648733 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb8afd-3ead-470a-8626-d1ebbbb6c931 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:42.733615 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf77ee-1a24-4095-b818-f1f964622f65 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:42.753564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb8afd-3ead-470a-8626-d1ebbbb6c931 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:42.769302 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0632bb-42b2-41db-8ddf-a20b49995c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:42.770208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0632bb-42b2-41db-8ddf-a20b49995c0c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:42.770493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0632bb-42b2-41db-8ddf-a20b49995c0c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:42.770771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0632bb-42b2-41db-8ddf-a20b49995c0c None admin] PATH_INFO: `/v3/projects/2d0172f0deac4b64babafdb092e05fd8` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.772149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0632bb-42b2-41db-8ddf-a20b49995c0c None admin] RBAC: Authorizing `identity:get_project(project_id=2d0172f0deac4b64babafdb092e05fd8)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:42.773624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0632bb-42b2-41db-8ddf-a20b49995c0c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:42.775476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 223/449] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:42 2022] GET /identity/v3/projects/2d0172f0deac4b64babafdb092e05fd8 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:42.781278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0632bb-42b2-41db-8ddf-a20b49995c0c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:42.791457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d83e7-34e5-4d6c-8b03-686405458167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:42.792267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d83e7-34e5-4d6c-8b03-686405458167 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:42.792634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d83e7-34e5-4d6c-8b03-686405458167 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:42.793035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d83e7-34e5-4d6c-8b03-686405458167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.867071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d83e7-34e5-4d6c-8b03-686405458167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:42.868967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d83e7-34e5-4d6c-8b03-686405458167 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:42.888648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0632bb-42b2-41db-8ddf-a20b49995c0c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:42.928426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f0d23-bcd9-4680-813a-a4f1242151f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:42.929304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f0d23-bcd9-4680-813a-a4f1242151f2 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:42.929585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f0d23-bcd9-4680-813a-a4f1242151f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:42.929847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f0d23-bcd9-4680-813a-a4f1242151f2 None admin] PATH_INFO: `/v3/groups/bf0bd7afe02c413585f98edb81d4ffac` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:42.931180 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f0d23-bcd9-4680-813a-a4f1242151f2 None admin] RBAC: Authorizing `identity:get_group(group_id=bf0bd7afe02c413585f98edb81d4ffac)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:42.932778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f0d23-bcd9-4680-813a-a4f1242151f2 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:42.934495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 224/450] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:42 2022] GET /identity/v3/groups/bf0bd7afe02c413585f98edb81d4ffac => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:42.941280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f0d23-bcd9-4680-813a-a4f1242151f2 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:42.977749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 227/451] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:42.984051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d83e7-34e5-4d6c-8b03-686405458167 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:43.072679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f0d23-bcd9-4680-813a-a4f1242151f2 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:43.125328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c58910-e4f4-4da9-a573-c43c84fc6357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:43.125971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d83e7-34e5-4d6c-8b03-686405458167 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:43.126395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58910-e4f4-4da9-a573-c43c84fc6357 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:43.126823 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58910-e4f4-4da9-a573-c43c84fc6357 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:43.127258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58910-e4f4-4da9-a573-c43c84fc6357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:43.128633 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c58910-e4f4-4da9-a573-c43c84fc6357 None admin] RBAC: Adding query filter params (group.id=bf0bd7afe02c413585f98edb81d4ffac, role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=2d0172f0deac4b64babafdb092e05fd8) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:43.129138 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c58910-e4f4-4da9-a573-c43c84fc6357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:43.131220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c58910-e4f4-4da9-a573-c43c84fc6357 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:43.138030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 225/452] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:42 2022] GET /identity/v3/role_assignments?group.id=bf0bd7afe02c413585f98edb81d4ffac&scope.project.id=2d0172f0deac4b64babafdb092e05fd8&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:43.171294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22a2e7-2d04-4079-9489-a0ac7a921630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:43.172123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22a2e7-2d04-4079-9489-a0ac7a921630 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:43.172404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22a2e7-2d04-4079-9489-a0ac7a921630 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:43.172669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22a2e7-2d04-4079-9489-a0ac7a921630 None admin] PATH_INFO: `/v3/projects/9df87fda527d419183d70b258d3b9b6b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:43.174212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22a2e7-2d04-4079-9489-a0ac7a921630 None admin] RBAC: Authorizing `identity:get_project(project_id=9df87fda527d419183d70b258d3b9b6b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:43.175729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22a2e7-2d04-4079-9489-a0ac7a921630 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:43.177606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 228/453] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:39:42 2022] GET /identity/v3/projects/9df87fda527d419183d70b258d3b9b6b => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:43.184309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c58910-e4f4-4da9-a573-c43c84fc6357 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:43.331907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c58910-e4f4-4da9-a573-c43c84fc6357 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:43.376453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c403-3745-4a62-a467-48f1c11eb833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:43.377330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c403-3745-4a62-a467-48f1c11eb833 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:43.377607 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c403-3745-4a62-a467-48f1c11eb833 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:43.377876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c403-3745-4a62-a467-48f1c11eb833 None admin] PATH_INFO: `/v3/groups/ceea5c167da948a2a432da58bbf76cd4` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:43.379182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c403-3745-4a62-a467-48f1c11eb833 None admin] RBAC: Authorizing `identity:get_group(group_id=ceea5c167da948a2a432da58bbf76cd4)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:43.380653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c403-3745-4a62-a467-48f1c11eb833 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:43.382740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 226/454] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Mar 22 19:39:43 2022] GET /identity/v3/groups/ceea5c167da948a2a432da58bbf76cd4 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:43.391551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22a2e7-2d04-4079-9489-a0ac7a921630 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:43.520298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22a2e7-2d04-4079-9489-a0ac7a921630 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:43.562622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c795e-cae5-4375-9967-bfde07c38272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:43.563402 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c795e-cae5-4375-9967-bfde07c38272 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:43.563761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c795e-cae5-4375-9967-bfde07c38272 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:43.564146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c795e-cae5-4375-9967-bfde07c38272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:43.565466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c795e-cae5-4375-9967-bfde07c38272 None admin] RBAC: Adding query filter params (group.id=ceea5c167da948a2a432da58bbf76cd4, role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=9df87fda527d419183d70b258d3b9b6b) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:43.565985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c795e-cae5-4375-9967-bfde07c38272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:43.567988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c795e-cae5-4375-9967-bfde07c38272 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:43.575948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 229/455] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Mar 22 19:39:43 2022] GET /identity/v3/role_assignments?group.id=ceea5c167da948a2a432da58bbf76cd4&scope.project.id=9df87fda527d419183d70b258d3b9b6b&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:46.843983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fadc8-2ed5-4c8f-85ce-f151e99ea43e None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:46.844768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fadc8-2ed5-4c8f-85ce-f151e99ea43e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:46.845238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fadc8-2ed5-4c8f-85ce-f151e99ea43e None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:46.847720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 227/456] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:46.854422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a44bcd-7403-4892-864b-5a8728e6a988 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:46.855394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a44bcd-7403-4892-864b-5a8728e6a988 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:46.855864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a44bcd-7403-4892-864b-5a8728e6a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:46.900306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-40a44bcd-7403-4892-864b-5a8728e6a988 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:46.902776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-40a44bcd-7403-4892-864b-5a8728e6a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:47.008177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebfd45-b5ec-4430-92e3-ec8939737e64 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.009028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebfd45-b5ec-4430-92e3-ec8939737e64 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.009507 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebfd45-b5ec-4430-92e3-ec8939737e64 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.011854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 228/457] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:47.017600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363038d-3d13-4a27-a1cc-aa8e5ae80b39 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.017883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363038d-3d13-4a27-a1cc-aa8e5ae80b39 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.018353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363038d-3d13-4a27-a1cc-aa8e5ae80b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.052192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a363038d-3d13-4a27-a1cc-aa8e5ae80b39 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:47.054301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a363038d-3d13-4a27-a1cc-aa8e5ae80b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:47.060367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 230/458] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:47.088058 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a44bcd-7403-4892-864b-5a8728e6a988 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:47.180848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 229/459] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:47.231435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363038d-3d13-4a27-a1cc-aa8e5ae80b39 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:47.284156 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a44bcd-7403-4892-864b-5a8728e6a988 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:47.349863 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c08188-21fe-416e-9ceb-5c3d8da8613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:47.351267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c08188-21fe-416e-9ceb-5c3d8da8613d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.351764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c08188-21fe-416e-9ceb-5c3d8da8613d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.352459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c08188-21fe-416e-9ceb-5c3d8da8613d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.364504 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363038d-3d13-4a27-a1cc-aa8e5ae80b39 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:47.369966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c08188-21fe-416e-9ceb-5c3d8da8613d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:47.372230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c08188-21fe-416e-9ceb-5c3d8da8613d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:47.407965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-55c08188-21fe-416e-9ceb-5c3d8da8613d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:47.408161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75bdc0-2c64-48d1-850d-523a81728a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:47.408256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 231/460] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:47.408354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75bdc0-2c64-48d1-850d-523a81728a32 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.408354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75bdc0-2c64-48d1-850d-523a81728a32 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.408354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75bdc0-2c64-48d1-850d-523a81728a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.408530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2bcb2-89d2-4278-ab0f-8adadcfc5599 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.408530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2bcb2-89d2-4278-ab0f-8adadcfc5599 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.408530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2bcb2-89d2-4278-ab0f-8adadcfc5599 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.411875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 232/461] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:47.413159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2bcb2-89d2-4278-ab0f-8adadcfc5599 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:47.421478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75bdc0-2c64-48d1-850d-523a81728a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:47.423348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75bdc0-2c64-48d1-850d-523a81728a32 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:47.442342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-bb75bdc0-2c64-48d1-850d-523a81728a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:47.444257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 230/462] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:47.446209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5667c2-e064-4d3e-b495-83a99087d627 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.446678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5667c2-e064-4d3e-b495-83a99087d627 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.447072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5667c2-e064-4d3e-b495-83a99087d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.465088 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7a5667c2-e064-4d3e-b495-83a99087d627 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:47.466333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7a5667c2-e064-4d3e-b495-83a99087d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:47.561754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 231/463] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:47.561754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998ca15-56e8-45c7-ab06-2fdb4416e60d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.561754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998ca15-56e8-45c7-ab06-2fdb4416e60d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.561754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998ca15-56e8-45c7-ab06-2fdb4416e60d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.561754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 232/464] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:47.561754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998ca15-56e8-45c7-ab06-2fdb4416e60d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:47.610104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2bcb2-89d2-4278-ab0f-8adadcfc5599 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:47.671361 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce7810-77ae-4e00-a9b1-02f867027817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:47.672241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7810-77ae-4e00-a9b1-02f867027817 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.672662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7810-77ae-4e00-a9b1-02f867027817 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.673058 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7810-77ae-4e00-a9b1-02f867027817 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.673927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7810-77ae-4e00-a9b1-02f867027817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:47.674427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7810-77ae-4e00-a9b1-02f867027817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:47.676203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7810-77ae-4e00-a9b1-02f867027817 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:47.699794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 233/465] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:47.701550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cd9e8-aba4-4fd6-aac2-b7ff995f8617 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.702004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cd9e8-aba4-4fd6-aac2-b7ff995f8617 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.702435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cd9e8-aba4-4fd6-aac2-b7ff995f8617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.726623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-011cd9e8-aba4-4fd6-aac2-b7ff995f8617 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:47.728191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-011cd9e8-aba4-4fd6-aac2-b7ff995f8617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:47.747859 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998ca15-56e8-45c7-ab06-2fdb4416e60d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:47.803371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983465-9252-4682-8a9c-6b2e4a234d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:47.804224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983465-9252-4682-8a9c-6b2e4a234d8d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:47.804624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983465-9252-4682-8a9c-6b2e4a234d8d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:47.805059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983465-9252-4682-8a9c-6b2e4a234d8d None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:47.806391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983465-9252-4682-8a9c-6b2e4a234d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:47.806792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983465-9252-4682-8a9c-6b2e4a234d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:47.808362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983465-9252-4682-8a9c-6b2e4a234d8d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:47.828886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 233/466] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:47.828886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983465-9252-4682-8a9c-6b2e4a234d8d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:47.854119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 234/467] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:47.855540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011cd9e8-aba4-4fd6-aac2-b7ff995f8617 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:47.964422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983465-9252-4682-8a9c-6b2e4a234d8d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:48.009625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a556f-c2e5-488c-8ce8-204c95fba7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:48.010493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a556f-c2e5-488c-8ce8-204c95fba7b3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:48.010771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a556f-c2e5-488c-8ce8-204c95fba7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:48.011039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a556f-c2e5-488c-8ce8-204c95fba7b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:48.020228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011cd9e8-aba4-4fd6-aac2-b7ff995f8617 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:48.023298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a556f-c2e5-488c-8ce8-204c95fba7b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:48.024847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a556f-c2e5-488c-8ce8-204c95fba7b3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:48.043045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-559a556f-c2e5-488c-8ce8-204c95fba7b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:48.044331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 234/468] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:48.047102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a556f-c2e5-488c-8ce8-204c95fba7b3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:48.083499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf495f1-034a-4710-91f9-f7b6f182cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:48.084968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf495f1-034a-4710-91f9-f7b6f182cc5d None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:48.085680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf495f1-034a-4710-91f9-f7b6f182cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:48.086422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf495f1-034a-4710-91f9-f7b6f182cc5d None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:48.087921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf495f1-034a-4710-91f9-f7b6f182cc5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:48.091023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf495f1-034a-4710-91f9-f7b6f182cc5d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:48.125221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 235/469] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:39:47 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:39:48.126845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf495f1-034a-4710-91f9-f7b6f182cc5d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:48.242849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a556f-c2e5-488c-8ce8-204c95fba7b3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:48.328907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09a397-08fa-4cf2-be03-7e428f96f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:48.330114 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a397-08fa-4cf2-be03-7e428f96f410 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:48.330593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a397-08fa-4cf2-be03-7e428f96f410 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:48.331068 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a397-08fa-4cf2-be03-7e428f96f410 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:48.332853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09a397-08fa-4cf2-be03-7e428f96f410 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:48.336861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09a397-08fa-4cf2-be03-7e428f96f410 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:48.339596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf495f1-034a-4710-91f9-f7b6f182cc5d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:48.377452 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 235/470] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:39:48 2022] POST /identity/v3/users => generated 246 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:39:48.379637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09a397-08fa-4cf2-be03-7e428f96f410 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:48.421932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe7b04-463b-41f6-b20d-3a7b665b9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:48.423592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe7b04-463b-41f6-b20d-3a7b665b9323 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:48.424090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe7b04-463b-41f6-b20d-3a7b665b9323 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:48.424642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe7b04-463b-41f6-b20d-3a7b665b9323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:48.453239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe7b04-463b-41f6-b20d-3a7b665b9323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:48.456185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe7b04-463b-41f6-b20d-3a7b665b9323 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:48.502885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-06fe7b04-463b-41f6-b20d-3a7b665b9323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:48.507187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 236/471] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:48.519710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe7b04-463b-41f6-b20d-3a7b665b9323 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:48.635593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09a397-08fa-4cf2-be03-7e428f96f410 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:48.713931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444d4ff-4073-4eb1-a830-dbda5da52e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:48.715661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444d4ff-4073-4eb1-a830-dbda5da52e8e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:48.716480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444d4ff-4073-4eb1-a830-dbda5da52e8e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:48.717252 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444d4ff-4073-4eb1-a830-dbda5da52e8e None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:48.719035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444d4ff-4073-4eb1-a830-dbda5da52e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:48.719921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444d4ff-4073-4eb1-a830-dbda5da52e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:48.722983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444d4ff-4073-4eb1-a830-dbda5da52e8e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:48.723249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe7b04-463b-41f6-b20d-3a7b665b9323 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:48.746000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 236/472] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:48.746000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479af4cc-7e68-4677-9f9c-c07653213274 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:48.746000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479af4cc-7e68-4677-9f9c-c07653213274 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:48.746000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479af4cc-7e68-4677-9f9c-c07653213274 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:48.746613 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 237/473] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:48.752559 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479af4cc-7e68-4677-9f9c-c07653213274 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:48.777848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22bf87-ab82-4f1b-8697-a7624e110a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:48.778461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22bf87-ab82-4f1b-8697-a7624e110a49 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:48.778742 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22bf87-ab82-4f1b-8697-a7624e110a49 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:48.779046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22bf87-ab82-4f1b-8697-a7624e110a49 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:48.779784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22bf87-ab82-4f1b-8697-a7624e110a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:48.780096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22bf87-ab82-4f1b-8697-a7624e110a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:48.781756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22bf87-ab82-4f1b-8697-a7624e110a49 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:48.798587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 237/474] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:48.801994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444adca7-7c72-4d44-bd99-756770f2e9d5 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:48.801994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444adca7-7c72-4d44-bd99-756770f2e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:48.801994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444adca7-7c72-4d44-bd99-756770f2e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:48.824271 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-444adca7-7c72-4d44-bd99-756770f2e9d5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:48.825496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-444adca7-7c72-4d44-bd99-756770f2e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:48.906394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 238/475] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:48.907402 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444adca7-7c72-4d44-bd99-756770f2e9d5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:48.956602 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479af4cc-7e68-4677-9f9c-c07653213274 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:49.013398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444adca7-7c72-4d44-bd99-756770f2e9d5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:49.021697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a503-ccde-4f8b-9ec5-6bd6bde2528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:49.023760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a503-ccde-4f8b-9ec5-6bd6bde2528d None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:49.024471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a503-ccde-4f8b-9ec5-6bd6bde2528d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:49.025156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a503-ccde-4f8b-9ec5-6bd6bde2528d None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:49.026734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a503-ccde-4f8b-9ec5-6bd6bde2528d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:49.029922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a503-ccde-4f8b-9ec5-6bd6bde2528d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:49.055088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76935ac1-89da-479d-a787-d64aa439e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:49.056047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935ac1-89da-479d-a787-d64aa439e884 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:49.056328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935ac1-89da-479d-a787-d64aa439e884 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:49.056657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935ac1-89da-479d-a787-d64aa439e884 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:49.057388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76935ac1-89da-479d-a787-d64aa439e884 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:49.059131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76935ac1-89da-479d-a787-d64aa439e884 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:49.076474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 238/476] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:39:48 2022] POST /identity/v3/users => generated 248 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:39:49.076474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a503-ccde-4f8b-9ec5-6bd6bde2528d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:49.097808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 239/477] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:39:48 2022] POST /identity/v3/users => generated 249 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:39:49.288064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a503-ccde-4f8b-9ec5-6bd6bde2528d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:49.359223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:49.360318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:49.360781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:49.361251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:49.362611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:49.365045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:49.383642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.sql.core [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 22 19:39:49.383642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 22 19:39:49.383642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [parameters: {'id': '855e2be60276400b8c0b675b0afdd11f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 22 19:39:49.383642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 22 19:39:49.413300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 22 19:39:49.419987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 239/478] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Mar 22 19:39:49 2022] POST /identity/v3/roles => generated 144 bytes in 345 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:49.429836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76935ac1-89da-479d-a787-d64aa439e884 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:49.645631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76935ac1-89da-479d-a787-d64aa439e884 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:49.725383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78571a3-61fa-4888-9b5d-1b91c0a6dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:49.726787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78571a3-61fa-4888-9b5d-1b91c0a6dc46 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:49.727602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78571a3-61fa-4888-9b5d-1b91c0a6dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:49.727864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78571a3-61fa-4888-9b5d-1b91c0a6dc46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:49.749780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78571a3-61fa-4888-9b5d-1b91c0a6dc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:49.765415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-d78571a3-61fa-4888-9b5d-1b91c0a6dc46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 22 19:39:49.768592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 240/479] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:39:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:39:49.778220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:50.050644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72a1f-7eb0-47b3-a2da-83b3c46ddb3d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:50.120133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b4ff5-af6a-4c34-9160-00a986acf025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:50.121724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4ff5-af6a-4c34-9160-00a986acf025 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:50.122472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4ff5-af6a-4c34-9160-00a986acf025 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:50.123181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4ff5-af6a-4c34-9160-00a986acf025 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:50.124825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4ff5-af6a-4c34-9160-00a986acf025 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:50.125593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4ff5-af6a-4c34-9160-00a986acf025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:50.128386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4ff5-af6a-4c34-9160-00a986acf025 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:50.145008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 240/480] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:52.299695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8765-4aec-4c2b-a426-8d949f96812f None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:52.300225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8765-4aec-4c2b-a426-8d949f96812f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:52.300612 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8765-4aec-4c2b-a426-8d949f96812f None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:52.304836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 241/481] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:52.314776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23cb90-cd05-462e-ad5f-ed39cf8994c9 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:52.315371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23cb90-cd05-462e-ad5f-ed39cf8994c9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:52.315876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23cb90-cd05-462e-ad5f-ed39cf8994c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:52.343409 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-1d23cb90-cd05-462e-ad5f-ed39cf8994c9 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:52.344606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1d23cb90-cd05-462e-ad5f-ed39cf8994c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:52.442229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 241/482] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:52.525373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b8765-4aec-4c2b-a426-8d949f96812f None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:52.528052 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643c4c-51e5-4dcc-8228-b43d3cf2a94c None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:52.528370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643c4c-51e5-4dcc-8228-b43d3cf2a94c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:52.528670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643c4c-51e5-4dcc-8228-b43d3cf2a94c None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:52.531091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 242/483] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:52.536996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819eea-81eb-4bd6-ad14-4e6c4977c1b7 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:52.537284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819eea-81eb-4bd6-ad14-4e6c4977c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:52.537566 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2819eea-81eb-4bd6-ad14-4e6c4977c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:52.556564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-b2819eea-81eb-4bd6-ad14-4e6c4977c1b7 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:52.557721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b2819eea-81eb-4bd6-ad14-4e6c4977c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:52.635253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 243/484] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:39:52.660851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2819eea-81eb-4bd6-ad14-4e6c4977c1b7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:52.787166 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2819eea-81eb-4bd6-ad14-4e6c4977c1b7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:52.797984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b8765-4aec-4c2b-a426-8d949f96812f None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:52.827640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbb1c7-d474-457c-8a72-871fb8a88749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:52.828466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbb1c7-d474-457c-8a72-871fb8a88749 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:52.828751 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbb1c7-d474-457c-8a72-871fb8a88749 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:52.829027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbb1c7-d474-457c-8a72-871fb8a88749 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:52.844879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbb1c7-d474-457c-8a72-871fb8a88749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:52.854457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-05cbb1c7-d474-457c-8a72-871fb8a88749 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:39:52.860791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 244/485] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:39:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:52.861130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec078f4-4d4f-4bc8-adc4-c32ee04f6a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:52.862326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173dd4-16df-4770-89df-01fd089958b7 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:52.862562 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec078f4-4d4f-4bc8-adc4-c32ee04f6a20 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:52.862662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173dd4-16df-4770-89df-01fd089958b7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:52.862885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84173dd4-16df-4770-89df-01fd089958b7 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:52.863062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec078f4-4d4f-4bc8-adc4-c32ee04f6a20 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:52.863543 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec078f4-4d4f-4bc8-adc4-c32ee04f6a20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:52.864981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 245/486] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:52.865729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84173dd4-16df-4770-89df-01fd089958b7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:52.886949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec078f4-4d4f-4bc8-adc4-c32ee04f6a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:52.901369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-eec078f4-4d4f-4bc8-adc4-c32ee04f6a20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:39:52.910132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 242/487] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:39:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:52.911726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de27caf-efd4-467d-b265-3983273aa81e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:52.912048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de27caf-efd4-467d-b265-3983273aa81e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:52.912333 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de27caf-efd4-467d-b265-3983273aa81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:52.958534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0de27caf-efd4-467d-b265-3983273aa81e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:52.961159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0de27caf-efd4-467d-b265-3983273aa81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:53.022510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84173dd4-16df-4770-89df-01fd089958b7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:53.066596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2d93b-a4a8-4220-82cd-c38778f82433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:53.067470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2d93b-a4a8-4220-82cd-c38778f82433 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:53.067889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2d93b-a4a8-4220-82cd-c38778f82433 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:53.068289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2d93b-a4a8-4220-82cd-c38778f82433 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:53.069340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2d93b-a4a8-4220-82cd-c38778f82433 None admin] RBAC: Adding query filter params (name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:53.070030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2d93b-a4a8-4220-82cd-c38778f82433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:53.073344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2d93b-a4a8-4220-82cd-c38778f82433 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:53.083977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 246/488] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:53.089747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2d93b-a4a8-4220-82cd-c38778f82433 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:53.103553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 243/489] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:53.105279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de27caf-efd4-467d-b265-3983273aa81e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:53.229496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2d93b-a4a8-4220-82cd-c38778f82433 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:53.264201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de27caf-efd4-467d-b265-3983273aa81e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:53.268923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7704e65-3023-46df-bae4-a48e090ad83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:53.270013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7704e65-3023-46df-bae4-a48e090ad83c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:53.270298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7704e65-3023-46df-bae4-a48e090ad83c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:53.270576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7704e65-3023-46df-bae4-a48e090ad83c None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:53.271340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7704e65-3023-46df-bae4-a48e090ad83c None admin] RBAC: Adding query filter params (name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:53.271651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7704e65-3023-46df-bae4-a48e090ad83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:53.273060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7704e65-3023-46df-bae4-a48e090ad83c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:53.282688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 247/490] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:39:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:53.283730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7704e65-3023-46df-bae4-a48e090ad83c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:53.321954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a847b-eda0-4669-bff9-6ae64c57c34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:53.323414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a847b-eda0-4669-bff9-6ae64c57c34e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:53.323896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a847b-eda0-4669-bff9-6ae64c57c34e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:53.324380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a847b-eda0-4669-bff9-6ae64c57c34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:53.343898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a847b-eda0-4669-bff9-6ae64c57c34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:53.346638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a847b-eda0-4669-bff9-6ae64c57c34e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:53.368411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-727a847b-eda0-4669-bff9-6ae64c57c34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:53.370690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 244/491] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:53.370690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a847b-eda0-4669-bff9-6ae64c57c34e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:53.404664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7704e65-3023-46df-bae4-a48e090ad83c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:53.452395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bcf88-cab3-4b81-98fe-5259de1cd40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:53.453893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bcf88-cab3-4b81-98fe-5259de1cd40e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:53.454427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bcf88-cab3-4b81-98fe-5259de1cd40e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:53.454935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bcf88-cab3-4b81-98fe-5259de1cd40e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:53.476468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bcf88-cab3-4b81-98fe-5259de1cd40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:53.491269 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-7b0bcf88-cab3-4b81-98fe-5259de1cd40e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:39:53.500936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 248/492] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:53.501191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a847b-eda0-4669-bff9-6ae64c57c34e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:53.501328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d63c48-698d-470c-a4b3-5b7340426516 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:53.501328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d63c48-698d-470c-a4b3-5b7340426516 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:53.501328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d63c48-698d-470c-a4b3-5b7340426516 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:53.501328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 249/493] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:53.502623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d63c48-698d-470c-a4b3-5b7340426516 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:53.553008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babde4e-dec2-4d13-8c6d-0f88646f92d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:53.556001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babde4e-dec2-4d13-8c6d-0f88646f92d8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:53.556001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babde4e-dec2-4d13-8c6d-0f88646f92d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:53.556527 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babde4e-dec2-4d13-8c6d-0f88646f92d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:53.579040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babde4e-dec2-4d13-8c6d-0f88646f92d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:53.582035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babde4e-dec2-4d13-8c6d-0f88646f92d8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:53.609925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-9babde4e-dec2-4d13-8c6d-0f88646f92d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:53.619124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 245/494] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:53.619124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177296-ad4c-4084-b257-d8f9fc56927a None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:53.619124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177296-ad4c-4084-b257-d8f9fc56927a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:53.619124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177296-ad4c-4084-b257-d8f9fc56927a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:53.637830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d4177296-ad4c-4084-b257-d8f9fc56927a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:53.639133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d4177296-ad4c-4084-b257-d8f9fc56927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:53.700389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d63c48-698d-470c-a4b3-5b7340426516 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:53.742210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a104d6-187a-4f5c-8874-5f0489704494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:53.743066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a104d6-187a-4f5c-8874-5f0489704494 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:53.743644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a104d6-187a-4f5c-8874-5f0489704494 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:53.743644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a104d6-187a-4f5c-8874-5f0489704494 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:53.744423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a104d6-187a-4f5c-8874-5f0489704494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:53.744795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a104d6-187a-4f5c-8874-5f0489704494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:53.745447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 246/495] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:53.746814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4177296-ad4c-4084-b257-d8f9fc56927a None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:53.752500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a104d6-187a-4f5c-8874-5f0489704494 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:53.777755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 250/496] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:53.779684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a104d6-187a-4f5c-8874-5f0489704494 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:53.939102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4177296-ad4c-4084-b257-d8f9fc56927a None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:53.955033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a104d6-187a-4f5c-8874-5f0489704494 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:53.998599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb3c7a-abb7-4cf3-84b4-1e74219c8771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:53.999291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb3c7a-abb7-4cf3-84b4-1e74219c8771 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:53.999570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb3c7a-abb7-4cf3-84b4-1e74219c8771 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:53.999870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb3c7a-abb7-4cf3-84b4-1e74219c8771 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.000669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb3c7a-abb7-4cf3-84b4-1e74219c8771 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:54.000971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb3c7a-abb7-4cf3-84b4-1e74219c8771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:54.002366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb3c7a-abb7-4cf3-84b4-1e74219c8771 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:54.003858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c88d08-3c01-42cd-9694-02490abbe608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:54.005240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88d08-3c01-42cd-9694-02490abbe608 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.005977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88d08-3c01-42cd-9694-02490abbe608 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.006543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88d08-3c01-42cd-9694-02490abbe608 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.007896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c88d08-3c01-42cd-9694-02490abbe608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:54.008622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c88d08-3c01-42cd-9694-02490abbe608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:54.011311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c88d08-3c01-42cd-9694-02490abbe608 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:54.020226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 247/497] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:39:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:54.020226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb3c7a-abb7-4cf3-84b4-1e74219c8771 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:54.050000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 251/498] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:54.050000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c88d08-3c01-42cd-9694-02490abbe608 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:54.144698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb3c7a-abb7-4cf3-84b4-1e74219c8771 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:54.185395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2604f2-c057-4443-86d5-bc3811c1fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:54.186735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2604f2-c057-4443-86d5-bc3811c1fa8b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.187186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2604f2-c057-4443-86d5-bc3811c1fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.187639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2604f2-c057-4443-86d5-bc3811c1fa8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.197601 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c88d08-3c01-42cd-9694-02490abbe608 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:54.204521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2604f2-c057-4443-86d5-bc3811c1fa8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:39:54.217097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-8d2604f2-c057-4443-86d5-bc3811c1fa8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:39:54.219396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 248/499] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:54.220516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2604f2-c057-4443-86d5-bc3811c1fa8b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:54.247235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57edbd3-cefd-4c28-8ebb-0c3fa5d885b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:54.248192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57edbd3-cefd-4c28-8ebb-0c3fa5d885b3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.248574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57edbd3-cefd-4c28-8ebb-0c3fa5d885b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.248934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57edbd3-cefd-4c28-8ebb-0c3fa5d885b3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.257511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57edbd3-cefd-4c28-8ebb-0c3fa5d885b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:54.259468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57edbd3-cefd-4c28-8ebb-0c3fa5d885b3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:54.283060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b57edbd3-cefd-4c28-8ebb-0c3fa5d885b3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 22 19:39:54.292532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 252/500] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:54.292532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57edbd3-cefd-4c28-8ebb-0c3fa5d885b3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:54.350502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2604f2-c057-4443-86d5-bc3811c1fa8b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:54.391085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c775f-de0f-48a3-803e-133a858c8729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:54.392143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c775f-de0f-48a3-803e-133a858c8729 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.392548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c775f-de0f-48a3-803e-133a858c8729 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.392892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c775f-de0f-48a3-803e-133a858c8729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.406728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c775f-de0f-48a3-803e-133a858c8729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:54.407631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57edbd3-cefd-4c28-8ebb-0c3fa5d885b3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:54.409272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c775f-de0f-48a3-803e-133a858c8729 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:54.436827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-b69c775f-de0f-48a3-803e-133a858c8729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:54.443845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 249/501] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:54.443845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fb0bc-4724-4aea-9b02-cf950fda5305 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.443845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fb0bc-4724-4aea-9b02-cf950fda5305 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.443845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fb0bc-4724-4aea-9b02-cf950fda5305 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.444592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 250/502] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:39:54.445606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fb0bc-4724-4aea-9b02-cf950fda5305 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:54.459373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abef5b2-a852-401e-bb62-8d07cd2652ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:54.460155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef5b2-a852-401e-bb62-8d07cd2652ad None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.460581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef5b2-a852-401e-bb62-8d07cd2652ad None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.460941 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef5b2-a852-401e-bb62-8d07cd2652ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.470234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abef5b2-a852-401e-bb62-8d07cd2652ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:54.471795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abef5b2-a852-401e-bb62-8d07cd2652ad None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:54.487707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-6abef5b2-a852-401e-bb62-8d07cd2652ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 22 19:39:54.489129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 253/503] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Mar 22 19:39:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:54.490489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abef5b2-a852-401e-bb62-8d07cd2652ad None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:54.573921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fb0bc-4724-4aea-9b02-cf950fda5305 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:54.624356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a8a2b-299a-4751-a835-3b9bf34baa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:54.625044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a8a2b-299a-4751-a835-3b9bf34baa44 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.625321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a8a2b-299a-4751-a835-3b9bf34baa44 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.625646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a8a2b-299a-4751-a835-3b9bf34baa44 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.626373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a8a2b-299a-4751-a835-3b9bf34baa44 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:54.626672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a8a2b-299a-4751-a835-3b9bf34baa44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:54.628070 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a8a2b-299a-4751-a835-3b9bf34baa44 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:54.634070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abef5b2-a852-401e-bb62-8d07cd2652ad None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:54.637584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 251/504] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:54.639019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a8a2b-299a-4751-a835-3b9bf34baa44 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:54.688860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9fd99-f301-4338-9159-a338456a933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:54.689540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9fd99-f301-4338-9159-a338456a933d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.689815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9fd99-f301-4338-9159-a338456a933d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.690121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9fd99-f301-4338-9159-a338456a933d None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.690965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9fd99-f301-4338-9159-a338456a933d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:54.691256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9fd99-f301-4338-9159-a338456a933d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:54.692715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9fd99-f301-4338-9159-a338456a933d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:54.731928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 254/505] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Mar 22 19:39:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:54.733153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f3b95-3d91-4fc0-8121-e70b1a8abbf7 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.733432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f3b95-3d91-4fc0-8121-e70b1a8abbf7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.733707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f3b95-3d91-4fc0-8121-e70b1a8abbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.755318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6e4f3b95-3d91-4fc0-8121-e70b1a8abbf7 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:54.756593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6e4f3b95-3d91-4fc0-8121-e70b1a8abbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:54.791644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a8a2b-299a-4751-a835-3b9bf34baa44 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:54.828360 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 255/506] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:54.829163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f3b95-3d91-4fc0-8121-e70b1a8abbf7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:54.863753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1b872-bf70-4061-a40b-306f8cbfc6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:54.864875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1b872-bf70-4061-a40b-306f8cbfc6ea None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.865319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1b872-bf70-4061-a40b-306f8cbfc6ea None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.865823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1b872-bf70-4061-a40b-306f8cbfc6ea None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.867193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1b872-bf70-4061-a40b-306f8cbfc6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:54.867780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1b872-bf70-4061-a40b-306f8cbfc6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:54.870373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1b872-bf70-4061-a40b-306f8cbfc6ea None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:54.896779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 252/507] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:54.896779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1b872-bf70-4061-a40b-306f8cbfc6ea None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:54.934182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f3b95-3d91-4fc0-8121-e70b1a8abbf7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:54.975342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994435f-a11a-4fdf-bdd7-d5a9753f9e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:54.976290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994435f-a11a-4fdf-bdd7-d5a9753f9e02 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:54.976717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994435f-a11a-4fdf-bdd7-d5a9753f9e02 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:54.977180 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994435f-a11a-4fdf-bdd7-d5a9753f9e02 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:54.978634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994435f-a11a-4fdf-bdd7-d5a9753f9e02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:54.979132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994435f-a11a-4fdf-bdd7-d5a9753f9e02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:54.981476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994435f-a11a-4fdf-bdd7-d5a9753f9e02 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:55.003397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 256/508] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Mar 22 19:39:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:55.004153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994435f-a11a-4fdf-bdd7-d5a9753f9e02 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:55.041858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1b872-bf70-4061-a40b-306f8cbfc6ea None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:55.080151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea7765-c1c2-4bfd-a4e7-d1d6611e64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:55.081052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea7765-c1c2-4bfd-a4e7-d1d6611e64ad None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:55.081332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea7765-c1c2-4bfd-a4e7-d1d6611e64ad None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:55.081608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea7765-c1c2-4bfd-a4e7-d1d6611e64ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:55.093732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea7765-c1c2-4bfd-a4e7-d1d6611e64ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:55.096559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea7765-c1c2-4bfd-a4e7-d1d6611e64ad None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:55.112001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994435f-a11a-4fdf-bdd7-d5a9753f9e02 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:55.127706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-75ea7765-c1c2-4bfd-a4e7-d1d6611e64ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:55.135827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 253/509] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:55.135827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea7765-c1c2-4bfd-a4e7-d1d6611e64ad None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:55.155408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740b3d-dcae-4bf1-b5e1-64532674ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:55.156177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740b3d-dcae-4bf1-b5e1-64532674ec59 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:55.156485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740b3d-dcae-4bf1-b5e1-64532674ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:55.156841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740b3d-dcae-4bf1-b5e1-64532674ec59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:55.231742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd740b3d-dcae-4bf1-b5e1-64532674ec59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:55.233211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd740b3d-dcae-4bf1-b5e1-64532674ec59 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:55.303592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea7765-c1c2-4bfd-a4e7-d1d6611e64ad None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:55.354294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 257/510] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:55.355175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740b3d-dcae-4bf1-b5e1-64532674ec59 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:55.364743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3051d-93b7-438a-af13-6353556a5c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:55.366175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3051d-93b7-438a-af13-6353556a5c25 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:55.366663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3051d-93b7-438a-af13-6353556a5c25 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:55.367157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3051d-93b7-438a-af13-6353556a5c25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:55.386299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3051d-93b7-438a-af13-6353556a5c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:55.389003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3051d-93b7-438a-af13-6353556a5c25 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:55.419792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-3da3051d-93b7-438a-af13-6353556a5c25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:55.422008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 254/511] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:55.423445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3051d-93b7-438a-af13-6353556a5c25 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:55.468357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740b3d-dcae-4bf1-b5e1-64532674ec59 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:55.507603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86346a24-73f3-49fd-a703-20a7a7e9f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:55.508564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86346a24-73f3-49fd-a703-20a7a7e9f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:55.508990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86346a24-73f3-49fd-a703-20a7a7e9f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:55.509272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86346a24-73f3-49fd-a703-20a7a7e9f5f4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:55.518803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86346a24-73f3-49fd-a703-20a7a7e9f5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:55.521419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86346a24-73f3-49fd-a703-20a7a7e9f5f4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:55.545656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-86346a24-73f3-49fd-a703-20a7a7e9f5f4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 22 19:39:55.552918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 258/512] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:39:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:55.552918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86346a24-73f3-49fd-a703-20a7a7e9f5f4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:55.564900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3051d-93b7-438a-af13-6353556a5c25 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:55.617925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c96665-7d82-4385-9e83-2fac5a35513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:55.617925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c96665-7d82-4385-9e83-2fac5a35513e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:55.619040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c96665-7d82-4385-9e83-2fac5a35513e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:55.619168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c96665-7d82-4385-9e83-2fac5a35513e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:55.673363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86346a24-73f3-49fd-a703-20a7a7e9f5f4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:55.701578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c96665-7d82-4385-9e83-2fac5a35513e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:55.703165 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c96665-7d82-4385-9e83-2fac5a35513e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:55.715517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15f48-f931-45be-97cd-f4149310f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:55.716317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15f48-f931-45be-97cd-f4149310f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:55.716723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15f48-f931-45be-97cd-f4149310f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:55.717085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15f48-f931-45be-97cd-f4149310f9b3 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:55.717912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15f48-f931-45be-97cd-f4149310f9b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:55.718346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15f48-f931-45be-97cd-f4149310f9b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:55.719863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15f48-f931-45be-97cd-f4149310f9b3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:55.734923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 259/513] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:55.735900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15f48-f931-45be-97cd-f4149310f9b3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:55.858677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 255/514] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:55.860107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c96665-7d82-4385-9e83-2fac5a35513e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:55.903922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15f48-f931-45be-97cd-f4149310f9b3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:55.965187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6449-29e6-4615-b5ed-fd6b429eda7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:55.966614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6449-29e6-4615-b5ed-fd6b429eda7b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:55.967146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6449-29e6-4615-b5ed-fd6b429eda7b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:55.967606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6449-29e6-4615-b5ed-fd6b429eda7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:55.979672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c96665-7d82-4385-9e83-2fac5a35513e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:55.988045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6449-29e6-4615-b5ed-fd6b429eda7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:55.989556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6449-29e6-4615-b5ed-fd6b429eda7b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:56.010865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-1eed6449-29e6-4615-b5ed-fd6b429eda7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:56.012541 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 260/515] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:56.013914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6449-29e6-4615-b5ed-fd6b429eda7b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:56.019547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb4b3-36c2-4687-8d0d-307491a8c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:56.020350 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb4b3-36c2-4687-8d0d-307491a8c12e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:56.020683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb4b3-36c2-4687-8d0d-307491a8c12e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:56.020963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fb4b3-36c2-4687-8d0d-307491a8c12e None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:56.021719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fb4b3-36c2-4687-8d0d-307491a8c12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:56.022046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fb4b3-36c2-4687-8d0d-307491a8c12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:56.023474 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fb4b3-36c2-4687-8d0d-307491a8c12e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:56.037269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 256/516] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:56.038193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb4b3-36c2-4687-8d0d-307491a8c12e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:56.129711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6449-29e6-4615-b5ed-fd6b429eda7b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:56.152225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fb4b3-36c2-4687-8d0d-307491a8c12e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:56.171323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6ddb6-dadf-45f6-86d0-b8a085f1535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:56.172124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6ddb6-dadf-45f6-86d0-b8a085f1535d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:56.172532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6ddb6-dadf-45f6-86d0-b8a085f1535d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:56.172927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6ddb6-dadf-45f6-86d0-b8a085f1535d None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:56.173981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6ddb6-dadf-45f6-86d0-b8a085f1535d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:56.174422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6ddb6-dadf-45f6-86d0-b8a085f1535d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:56.176148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6ddb6-dadf-45f6-86d0-b8a085f1535d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:56.196341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab201dfe-9d17-4039-9763-7f7301b0a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:56.197605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab201dfe-9d17-4039-9763-7f7301b0a6e7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:56.198229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab201dfe-9d17-4039-9763-7f7301b0a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:56.198665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab201dfe-9d17-4039-9763-7f7301b0a6e7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:56.199790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 261/517] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Mar 22 19:39:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:56.200660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6ddb6-dadf-45f6-86d0-b8a085f1535d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:56.211530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab201dfe-9d17-4039-9763-7f7301b0a6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:56.213232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab201dfe-9d17-4039-9763-7f7301b0a6e7 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:56.229759 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-ab201dfe-9d17-4039-9763-7f7301b0a6e7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 22 19:39:56.231167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 257/518] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:39:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:56.232495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab201dfe-9d17-4039-9763-7f7301b0a6e7 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:56.341237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab201dfe-9d17-4039-9763-7f7301b0a6e7 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:56.345275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6ddb6-dadf-45f6-86d0-b8a085f1535d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:56.376390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42676e03-228e-42d0-95d3-09d1f5a04fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:56.377168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42676e03-228e-42d0-95d3-09d1f5a04fa6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:56.377316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42676e03-228e-42d0-95d3-09d1f5a04fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:56.377594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42676e03-228e-42d0-95d3-09d1f5a04fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:56.378385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42676e03-228e-42d0-95d3-09d1f5a04fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:56.378697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42676e03-228e-42d0-95d3-09d1f5a04fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:56.380200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42676e03-228e-42d0-95d3-09d1f5a04fa6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:56.393478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 258/519] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:56.394401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42676e03-228e-42d0-95d3-09d1f5a04fa6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:56.407253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b4fbd-2fe4-4f68-83af-9a571f500a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:56.408611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b4fbd-2fe4-4f68-83af-9a571f500a04 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:56.409070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b4fbd-2fe4-4f68-83af-9a571f500a04 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:56.409562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b4fbd-2fe4-4f68-83af-9a571f500a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:56.428158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b4fbd-2fe4-4f68-83af-9a571f500a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:56.431075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b4fbd-2fe4-4f68-83af-9a571f500a04 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:56.461799 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-031b4fbd-2fe4-4f68-83af-9a571f500a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:56.470625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 262/520] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:56.470625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b4fbd-2fe4-4f68-83af-9a571f500a04 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:56.504375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42676e03-228e-42d0-95d3-09d1f5a04fa6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:56.538720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c6839-624c-4eb5-8fc8-a1a96179f6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:56.539403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c6839-624c-4eb5-8fc8-a1a96179f6ed None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:56.539687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c6839-624c-4eb5-8fc8-a1a96179f6ed None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:56.539957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c6839-624c-4eb5-8fc8-a1a96179f6ed None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:56.540707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c6839-624c-4eb5-8fc8-a1a96179f6ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:56.542243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c6839-624c-4eb5-8fc8-a1a96179f6ed None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:56.567723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 259/521] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:39:56 2022] POST /identity/v3/users => generated 247 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:39:56.569351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c6839-624c-4eb5-8fc8-a1a96179f6ed None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:56.617099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b4fbd-2fe4-4f68-83af-9a571f500a04 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:56.667215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028832a-f410-403c-829d-871a8b6d5d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:56.668331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028832a-f410-403c-829d-871a8b6d5d88 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:56.668824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028832a-f410-403c-829d-871a8b6d5d88 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:56.669422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028832a-f410-403c-829d-871a8b6d5d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:56.701919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c6839-624c-4eb5-8fc8-a1a96179f6ed None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:56.753177 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd18350-697e-44d0-9841-3ce9f8e542f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:56.754375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd18350-697e-44d0-9841-3ce9f8e542f1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:56.754860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd18350-697e-44d0-9841-3ce9f8e542f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:56.755389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd18350-697e-44d0-9841-3ce9f8e542f1 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:56.756992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd18350-697e-44d0-9841-3ce9f8e542f1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:56.757485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd18350-697e-44d0-9841-3ce9f8e542f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:56.760584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd18350-697e-44d0-9841-3ce9f8e542f1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:56.768494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028832a-f410-403c-829d-871a8b6d5d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:56.770181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028832a-f410-403c-829d-871a8b6d5d88 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:56.823880 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 260/522] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Mar 22 19:39:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:56.826551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd18350-697e-44d0-9841-3ce9f8e542f1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:56.887517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 263/523] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:56.888832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028832a-f410-403c-829d-871a8b6d5d88 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:56.992591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028832a-f410-403c-829d-871a8b6d5d88 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:57.028831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd18350-697e-44d0-9841-3ce9f8e542f1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:57.029554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6552f1-1bb0-4db9-b94e-2a13e4b058f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:57.030536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6552f1-1bb0-4db9-b94e-2a13e4b058f3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:57.031036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6552f1-1bb0-4db9-b94e-2a13e4b058f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:57.031530 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6552f1-1bb0-4db9-b94e-2a13e4b058f3 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:57.032467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6552f1-1bb0-4db9-b94e-2a13e4b058f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:57.032978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6552f1-1bb0-4db9-b94e-2a13e4b058f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:57.034646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6552f1-1bb0-4db9-b94e-2a13e4b058f3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:57.052639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 264/524] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:57.053969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6552f1-1bb0-4db9-b94e-2a13e4b058f3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:57.089601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f353fc3-182f-4152-89ea-7e1901cc90ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:57.090489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f353fc3-182f-4152-89ea-7e1901cc90ed None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:57.090775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f353fc3-182f-4152-89ea-7e1901cc90ed None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:57.091077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f353fc3-182f-4152-89ea-7e1901cc90ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:57.103546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f353fc3-182f-4152-89ea-7e1901cc90ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:57.106463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f353fc3-182f-4152-89ea-7e1901cc90ed None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:57.132493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-5f353fc3-182f-4152-89ea-7e1901cc90ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:39:57.135556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 261/525] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:57.143723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f353fc3-182f-4152-89ea-7e1901cc90ed None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:57.170572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6552f1-1bb0-4db9-b94e-2a13e4b058f3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:57.209363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d4f9-22e0-49e6-909d-57e976d3c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:57.209831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d4f9-22e0-49e6-909d-57e976d3c731 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:57.210157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d4f9-22e0-49e6-909d-57e976d3c731 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:57.210431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d4f9-22e0-49e6-909d-57e976d3c731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:57.333682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d4f9-22e0-49e6-909d-57e976d3c731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:57.335221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d4f9-22e0-49e6-909d-57e976d3c731 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:57.358052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f353fc3-182f-4152-89ea-7e1901cc90ed None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:57.407179 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc699c-8643-4371-9ade-6b17252627a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:57.408220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc699c-8643-4371-9ade-6b17252627a2 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:57.408220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc699c-8643-4371-9ade-6b17252627a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:57.408480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc699c-8643-4371-9ade-6b17252627a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:57.426028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc699c-8643-4371-9ade-6b17252627a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:57.428765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc699c-8643-4371-9ade-6b17252627a2 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:57.452247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-9adc699c-8643-4371-9ade-6b17252627a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:57.453513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 262/526] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:57.454334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc699c-8643-4371-9ade-6b17252627a2 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:57.472501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 265/527] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:39:57.475451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d4f9-22e0-49e6-909d-57e976d3c731 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:57.598202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d4f9-22e0-49e6-909d-57e976d3c731 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:57.630889 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc699c-8643-4371-9ade-6b17252627a2 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:57.656427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0991f82-b4b7-4461-b9af-66fc066b01f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:57.657098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0991f82-b4b7-4461-b9af-66fc066b01f0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:57.657431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0991f82-b4b7-4461-b9af-66fc066b01f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:57.657698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0991f82-b4b7-4461-b9af-66fc066b01f0 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:57.658576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0991f82-b4b7-4461-b9af-66fc066b01f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:57.658873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0991f82-b4b7-4461-b9af-66fc066b01f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:57.660364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0991f82-b4b7-4461-b9af-66fc066b01f0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:57.682983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 266/528] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:57.683878 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0991f82-b4b7-4461-b9af-66fc066b01f0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:57.703357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4ba6-1daa-4673-99f0-4061275e48dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:57.705159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4ba6-1daa-4673-99f0-4061275e48dc None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:57.705910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4ba6-1daa-4673-99f0-4061275e48dc None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:57.706431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4ba6-1daa-4673-99f0-4061275e48dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:57.719863 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4ba6-1daa-4673-99f0-4061275e48dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:57.722657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4ba6-1daa-4673-99f0-4061275e48dc None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:57.749600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-df8c4ba6-1daa-4673-99f0-4061275e48dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:39:57.758296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 263/529] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:57.758296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4ba6-1daa-4673-99f0-4061275e48dc None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:57.830844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0991f82-b4b7-4461-b9af-66fc066b01f0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:57.889098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687159-a506-49ee-a24d-e20442e79d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:57.890587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687159-a506-49ee-a24d-e20442e79d79 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:57.891315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687159-a506-49ee-a24d-e20442e79d79 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:57.892308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc687159-a506-49ee-a24d-e20442e79d79 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:57.893833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc687159-a506-49ee-a24d-e20442e79d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:57.894424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc687159-a506-49ee-a24d-e20442e79d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:57.898778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc687159-a506-49ee-a24d-e20442e79d79 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:57.909521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4ba6-1daa-4673-99f0-4061275e48dc None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:57.933140 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 267/530] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:57.933140 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687159-a506-49ee-a24d-e20442e79d79 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:57.974113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6818f4-a611-43cb-ae0f-392f513215e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:57.975493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6818f4-a611-43cb-ae0f-392f513215e3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:57.975978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6818f4-a611-43cb-ae0f-392f513215e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:57.976447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6818f4-a611-43cb-ae0f-392f513215e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:57.995258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6818f4-a611-43cb-ae0f-392f513215e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:57.997824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6818f4-a611-43cb-ae0f-392f513215e3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:58.024024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-6a6818f4-a611-43cb-ae0f-392f513215e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:39:58.025967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 264/531] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:58.027117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6818f4-a611-43cb-ae0f-392f513215e3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:58.068423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc687159-a506-49ee-a24d-e20442e79d79 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:58.126894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb362efa-8f8e-415e-aa4f-b70ac42ff91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:58.127928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb362efa-8f8e-415e-aa4f-b70ac42ff91c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:58.128395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb362efa-8f8e-415e-aa4f-b70ac42ff91c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:58.128847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb362efa-8f8e-415e-aa4f-b70ac42ff91c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:58.129892 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb362efa-8f8e-415e-aa4f-b70ac42ff91c None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=02aff559435a445db07636197a534f4c) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:58.130323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb362efa-8f8e-415e-aa4f-b70ac42ff91c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:58.131812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb362efa-8f8e-415e-aa4f-b70ac42ff91c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:58.138533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 268/532] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:57 2022] GET /identity/v3/role_assignments?user.id=02aff559435a445db07636197a534f4c&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:58.139477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb362efa-8f8e-415e-aa4f-b70ac42ff91c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:58.200819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6818f4-a611-43cb-ae0f-392f513215e3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:58.242217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9411f-69dd-4d68-ad1c-8e65a46c1cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:58.243114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9411f-69dd-4d68-ad1c-8e65a46c1cee None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:58.243415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9411f-69dd-4d68-ad1c-8e65a46c1cee None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:58.243808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9411f-69dd-4d68-ad1c-8e65a46c1cee None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:58.244715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9411f-69dd-4d68-ad1c-8e65a46c1cee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:58.245092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9411f-69dd-4d68-ad1c-8e65a46c1cee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:58.246772 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9411f-69dd-4d68-ad1c-8e65a46c1cee None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:58.273975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 265/533] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:58.273975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9411f-69dd-4d68-ad1c-8e65a46c1cee None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:58.331931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb362efa-8f8e-415e-aa4f-b70ac42ff91c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:58.381629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9411f-69dd-4d68-ad1c-8e65a46c1cee None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:58.395182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c849e1-887b-4c06-be44-8ac66f33ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:58.397066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c849e1-887b-4c06-be44-8ac66f33ca0d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:58.397844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c849e1-887b-4c06-be44-8ac66f33ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:58.398723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c849e1-887b-4c06-be44-8ac66f33ca0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:58.412568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c849e1-887b-4c06-be44-8ac66f33ca0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:58.416231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c849e1-887b-4c06-be44-8ac66f33ca0d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:58.422517 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146975e-1f8f-4a26-be0e-6fb5c5720a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:58.423341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146975e-1f8f-4a26-be0e-6fb5c5720a82 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:58.423475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146975e-1f8f-4a26-be0e-6fb5c5720a82 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:58.423831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146975e-1f8f-4a26-be0e-6fb5c5720a82 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:58.424443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146975e-1f8f-4a26-be0e-6fb5c5720a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:58.424745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146975e-1f8f-4a26-be0e-6fb5c5720a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:58.426239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146975e-1f8f-4a26-be0e-6fb5c5720a82 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:58.439877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 266/534] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:58.440783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146975e-1f8f-4a26-be0e-6fb5c5720a82 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:58.449700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-70c849e1-887b-4c06-be44-8ac66f33ca0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:39:58.453039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 269/535] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:58.454934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c849e1-887b-4c06-be44-8ac66f33ca0d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:58.592811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146975e-1f8f-4a26-be0e-6fb5c5720a82 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:58.639391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c849e1-887b-4c06-be44-8ac66f33ca0d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:58.661760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15f6cb-7239-436c-903f-bb655dd38f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:58.663659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15f6cb-7239-436c-903f-bb655dd38f5d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:58.664603 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15f6cb-7239-436c-903f-bb655dd38f5d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:58.665366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15f6cb-7239-436c-903f-bb655dd38f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:58.667483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15f6cb-7239-436c-903f-bb655dd38f5d None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=7f74d49fc68344899f70efb85eb1c97d) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:58.668391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15f6cb-7239-436c-903f-bb655dd38f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:58.671691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15f6cb-7239-436c-903f-bb655dd38f5d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:58.689167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 267/536] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:58 2022] GET /identity/v3/role_assignments?user.id=7f74d49fc68344899f70efb85eb1c97d&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:58.691337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15f6cb-7239-436c-903f-bb655dd38f5d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:58.717083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1799d0b-373c-4401-851d-5c5c376f4632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:58.718212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1799d0b-373c-4401-851d-5c5c376f4632 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:58.718693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1799d0b-373c-4401-851d-5c5c376f4632 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:58.719150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1799d0b-373c-4401-851d-5c5c376f4632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:58.739841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1799d0b-373c-4401-851d-5c5c376f4632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:58.750747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1799d0b-373c-4401-851d-5c5c376f4632 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:58.797110 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a1799d0b-373c-4401-851d-5c5c376f4632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:39:58.799740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 270/537] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:39:58.808910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1799d0b-373c-4401-851d-5c5c376f4632 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:58.906133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15f6cb-7239-436c-903f-bb655dd38f5d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:58.952398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb267c-0b57-4075-85be-ba259e2b0c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:58.953599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb267c-0b57-4075-85be-ba259e2b0c96 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:58.954204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb267c-0b57-4075-85be-ba259e2b0c96 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:58.954795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb267c-0b57-4075-85be-ba259e2b0c96 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:58.955882 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb267c-0b57-4075-85be-ba259e2b0c96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:58.956523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb267c-0b57-4075-85be-ba259e2b0c96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:58.958369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb267c-0b57-4075-85be-ba259e2b0c96 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:58.981815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 268/538] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:58.995830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb267c-0b57-4075-85be-ba259e2b0c96 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:59.183199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1799d0b-373c-4401-851d-5c5c376f4632 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:59.294480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a13b-8e67-4cd5-a95b-497a92be42d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:59.295545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a13b-8e67-4cd5-a95b-497a92be42d5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:59.296027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a13b-8e67-4cd5-a95b-497a92be42d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:59.296504 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a13b-8e67-4cd5-a95b-497a92be42d5 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:59.298066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782a13b-8e67-4cd5-a95b-497a92be42d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:59.298627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782a13b-8e67-4cd5-a95b-497a92be42d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:59.301378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782a13b-8e67-4cd5-a95b-497a92be42d5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:59.331613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb267c-0b57-4075-85be-ba259e2b0c96 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:59.355448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 271/539] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:59.362079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a13b-8e67-4cd5-a95b-497a92be42d5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:59.456641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aad4c-8b9a-48bd-ac70-f0d52ee3bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:59.457776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aad4c-8b9a-48bd-ac70-f0d52ee3bd1f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:59.458298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aad4c-8b9a-48bd-ac70-f0d52ee3bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:59.458788 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aad4c-8b9a-48bd-ac70-f0d52ee3bd1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:59.460381 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010aad4c-8b9a-48bd-ac70-f0d52ee3bd1f None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=c2e837368cdc4df29d945a4c8e662a94) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:59.460903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010aad4c-8b9a-48bd-ac70-f0d52ee3bd1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:59.463826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010aad4c-8b9a-48bd-ac70-f0d52ee3bd1f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:59.491925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 269/540] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:58 2022] GET /identity/v3/role_assignments?user.id=c2e837368cdc4df29d945a4c8e662a94&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 259 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:39:59.530377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fe96d-10ec-4b24-9e60-491e0c0ea02f None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:59.530862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fe96d-10ec-4b24-9e60-491e0c0ea02f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:59.531349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fe96d-10ec-4b24-9e60-491e0c0ea02f None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:59.535197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 270/541] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:39:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:39:59.547910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d269fab-3e08-49c5-9f98-3dc9563f3f35 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:59.548264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d269fab-3e08-49c5-9f98-3dc9563f3f35 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:59.548712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d269fab-3e08-49c5-9f98-3dc9563f3f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:59.601043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a13b-8e67-4cd5-a95b-497a92be42d5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:59.605549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6d269fab-3e08-49c5-9f98-3dc9563f3f35 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:39:59.607576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6d269fab-3e08-49c5-9f98-3dc9563f3f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:39:59.682929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c85907-e167-49b5-ab67-38a43289a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:59.684375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c85907-e167-49b5-ab67-38a43289a424 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:59.684891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c85907-e167-49b5-ab67-38a43289a424 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:59.685376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c85907-e167-49b5-ab67-38a43289a424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:39:59.691856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c85907-e167-49b5-ab67-38a43289a424 None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=908e60013ebe4372a803a2ae5223e2c6) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:39:59.692532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c85907-e167-49b5-ab67-38a43289a424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:39:59.694335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c85907-e167-49b5-ab67-38a43289a424 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:39:59.704903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 272/542] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:39:59 2022] GET /identity/v3/role_assignments?user.id=908e60013ebe4372a803a2ae5223e2c6&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 259 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:39:59.751623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 271/543] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:39:59.828276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c85907-e167-49b5-ab67-38a43289a424 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:39:59.952959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c85907-e167-49b5-ab67-38a43289a424 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:39:59.995998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ee01-bff0-41c5-a5f5-5be127587290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:39:59.997406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ee01-bff0-41c5-a5f5-5be127587290 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:39:59.997905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ee01-bff0-41c5-a5f5-5be127587290 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:39:59.998421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ee01-bff0-41c5-a5f5-5be127587290 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:00.022925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061ee01-bff0-41c5-a5f5-5be127587290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:00.037414 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b061ee01-bff0-41c5-a5f5-5be127587290 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:00.040297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 273/544] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:00.050005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d269fab-3e08-49c5-9f98-3dc9563f3f35 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:00.224986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d269fab-3e08-49c5-9f98-3dc9563f3f35 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:00.305405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9f73-2f84-4933-bab2-c46ee0562775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:00.306692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9f73-2f84-4933-bab2-c46ee0562775 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:00.307256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9f73-2f84-4933-bab2-c46ee0562775 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:00.307757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9f73-2f84-4933-bab2-c46ee0562775 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:00.309176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9f73-2f84-4933-bab2-c46ee0562775 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:00.309714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9f73-2f84-4933-bab2-c46ee0562775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:00.312486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9f73-2f84-4933-bab2-c46ee0562775 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:00.335178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 272/545] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:00.344497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ee01-bff0-41c5-a5f5-5be127587290 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:00.507668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ee01-bff0-41c5-a5f5-5be127587290 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:00.563246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e406d-0609-4d9a-943f-33169479c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:00.564073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e406d-0609-4d9a-943f-33169479c7cb None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:00.564353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e406d-0609-4d9a-943f-33169479c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:00.564624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e406d-0609-4d9a-943f-33169479c7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:00.582712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e406d-0609-4d9a-943f-33169479c7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:00.584206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e406d-0609-4d9a-943f-33169479c7cb None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:00.604803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-7b4e406d-0609-4d9a-943f-33169479c7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:00.606463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 274/546] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:00.615636 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9f73-2f84-4933-bab2-c46ee0562775 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:00.803822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9f73-2f84-4933-bab2-c46ee0562775 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:00.869484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc35a-3d73-4452-afda-404faae36539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:00.870223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc35a-3d73-4452-afda-404faae36539 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:00.870506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc35a-3d73-4452-afda-404faae36539 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:00.870780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc35a-3d73-4452-afda-404faae36539 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:00.871541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dc35a-3d73-4452-afda-404faae36539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:00.871846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dc35a-3d73-4452-afda-404faae36539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:00.873289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dc35a-3d73-4452-afda-404faae36539 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:00.893997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 273/547] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:00.902339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e406d-0609-4d9a-943f-33169479c7cb None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:01.140229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e406d-0609-4d9a-943f-33169479c7cb None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:01.186459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e03501-1e74-44f7-bb69-69ef5fc1d016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:01.187295 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e03501-1e74-44f7-bb69-69ef5fc1d016 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:01.187583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e03501-1e74-44f7-bb69-69ef5fc1d016 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:01.187861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e03501-1e74-44f7-bb69-69ef5fc1d016 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:01.202454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e03501-1e74-44f7-bb69-69ef5fc1d016 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:01.203978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e03501-1e74-44f7-bb69-69ef5fc1d016 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:01.225564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-48e03501-1e74-44f7-bb69-69ef5fc1d016 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 22 19:40:01.227292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 275/548] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:01.235686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc35a-3d73-4452-afda-404faae36539 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:01.392109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc35a-3d73-4452-afda-404faae36539 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:01.439634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5621ec-545c-4660-8e21-dfacb9fb83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:01.440840 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5621ec-545c-4660-8e21-dfacb9fb83e9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:01.441319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5621ec-545c-4660-8e21-dfacb9fb83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:01.441787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5621ec-545c-4660-8e21-dfacb9fb83e9 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:01.443606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5621ec-545c-4660-8e21-dfacb9fb83e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:01.444141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5621ec-545c-4660-8e21-dfacb9fb83e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:01.446915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5621ec-545c-4660-8e21-dfacb9fb83e9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:01.490697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 274/549] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Mar 22 19:40:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:01.499121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e03501-1e74-44f7-bb69-69ef5fc1d016 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:01.646713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e03501-1e74-44f7-bb69-69ef5fc1d016 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:01.685495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00191342-2d36-4997-b905-0955c7ebcd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:01.686562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00191342-2d36-4997-b905-0955c7ebcd2e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:01.687060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00191342-2d36-4997-b905-0955c7ebcd2e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:01.687521 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00191342-2d36-4997-b905-0955c7ebcd2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:01.788814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde888-8e85-4b3b-bdf0-061330800ffd None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:01.789562 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde888-8e85-4b3b-bdf0-061330800ffd None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:01.789562 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde888-8e85-4b3b-bdf0-061330800ffd None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:01.791591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00191342-2d36-4997-b905-0955c7ebcd2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:01.791709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 275/550] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:01.793641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00191342-2d36-4997-b905-0955c7ebcd2e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:01.800372 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9768d-9107-4421-a0ff-7ac6602c2a43 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:01.800852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9768d-9107-4421-a0ff-7ac6602c2a43 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:01.801339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9768d-9107-4421-a0ff-7ac6602c2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:01.851086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b2f9768d-9107-4421-a0ff-7ac6602c2a43 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:01.853430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b2f9768d-9107-4421-a0ff-7ac6602c2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:01.981180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 276/551] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:40:01.983144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 276/552] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:40:01.984000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380480-7888-46a4-97f6-3ecf9690c8b1 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:01.984457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380480-7888-46a4-97f6-3ecf9690c8b1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:01.984929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380480-7888-46a4-97f6-3ecf9690c8b1 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:01.988601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 277/553] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:01.991216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00191342-2d36-4997-b905-0955c7ebcd2e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:02.000043 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e49d-08e9-46d5-8124-32d89e000d83 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:02.000335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e49d-08e9-46d5-8124-32d89e000d83 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:02.000572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e49d-08e9-46d5-8124-32d89e000d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:02.035389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-cad4e49d-08e9-46d5-8124-32d89e000d83 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:02.040343 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-cad4e49d-08e9-46d5-8124-32d89e000d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:02.147476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00191342-2d36-4997-b905-0955c7ebcd2e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:02.194318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 278/554] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:02.195497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4e49d-08e9-46d5-8124-32d89e000d83 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:02.209251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dafbc-bd15-41f8-8b48-ab290428a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:02.211373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dafbc-bd15-41f8-8b48-ab290428a29c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:02.211373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dafbc-bd15-41f8-8b48-ab290428a29c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:02.211684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dafbc-bd15-41f8-8b48-ab290428a29c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:02.232636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dafbc-bd15-41f8-8b48-ab290428a29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:02.235467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dafbc-bd15-41f8-8b48-ab290428a29c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:02.270132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-c53dafbc-bd15-41f8-8b48-ab290428a29c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:02.273425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 277/555] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:02.275411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dafbc-bd15-41f8-8b48-ab290428a29c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:02.350243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4e49d-08e9-46d5-8124-32d89e000d83 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:02.390122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc501e86-35e7-465a-82ff-218192ff8b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:02.391043 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc501e86-35e7-465a-82ff-218192ff8b49 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:02.391277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc501e86-35e7-465a-82ff-218192ff8b49 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:02.391555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc501e86-35e7-465a-82ff-218192ff8b49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:02.404428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc501e86-35e7-465a-82ff-218192ff8b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:02.413761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-fc501e86-35e7-465a-82ff-218192ff8b49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:02.422133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 279/556] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:02.422133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc501e86-35e7-465a-82ff-218192ff8b49 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:02.460543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dafbc-bd15-41f8-8b48-ab290428a29c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:02.498676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf140b54-9081-495f-90ed-5a7076289cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:02.499771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140b54-9081-495f-90ed-5a7076289cac None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:02.500194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140b54-9081-495f-90ed-5a7076289cac None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:02.500615 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140b54-9081-495f-90ed-5a7076289cac None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:02.514657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf140b54-9081-495f-90ed-5a7076289cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:02.523018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-cf140b54-9081-495f-90ed-5a7076289cac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:02.524643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 278/557] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:02.525879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf140b54-9081-495f-90ed-5a7076289cac None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:02.538902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc501e86-35e7-465a-82ff-218192ff8b49 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:02.583590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1296e53-9ba5-4d9a-acb9-77190e095758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:02.584274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1296e53-9ba5-4d9a-acb9-77190e095758 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:02.584557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1296e53-9ba5-4d9a-acb9-77190e095758 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:02.584836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1296e53-9ba5-4d9a-acb9-77190e095758 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:02.585885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1296e53-9ba5-4d9a-acb9-77190e095758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:02.586478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1296e53-9ba5-4d9a-acb9-77190e095758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:02.588550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1296e53-9ba5-4d9a-acb9-77190e095758 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:02.606990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 280/558] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:02.609008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1296e53-9ba5-4d9a-acb9-77190e095758 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:02.691660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf140b54-9081-495f-90ed-5a7076289cac None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:02.741260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a62eff-8f74-47f0-8819-0232d6ca9b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:02.743012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a62eff-8f74-47f0-8819-0232d6ca9b01 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:02.743604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a62eff-8f74-47f0-8819-0232d6ca9b01 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:02.744041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1296e53-9ba5-4d9a-acb9-77190e095758 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:02.744315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a62eff-8f74-47f0-8819-0232d6ca9b01 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:02.745323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a62eff-8f74-47f0-8819-0232d6ca9b01 None admin] RBAC: Adding query filter params (name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:02.746140 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a62eff-8f74-47f0-8819-0232d6ca9b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:02.749485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a62eff-8f74-47f0-8819-0232d6ca9b01 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:02.759842 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 279/559] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:02.761097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a62eff-8f74-47f0-8819-0232d6ca9b01 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:02.795646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6f1a1-f11f-4c19-9c10-ce7cd5d08c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:02.796813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f1a1-f11f-4c19-9c10-ce7cd5d08c33 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:02.797295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f1a1-f11f-4c19-9c10-ce7cd5d08c33 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:02.797767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f1a1-f11f-4c19-9c10-ce7cd5d08c33 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:02.799198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6f1a1-f11f-4c19-9c10-ce7cd5d08c33 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:02.799724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6f1a1-f11f-4c19-9c10-ce7cd5d08c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:02.802033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6f1a1-f11f-4c19-9c10-ce7cd5d08c33 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:02.814833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 281/560] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:02.816508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e35f-18b5-4497-b521-33e61aa861da None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:02.816946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e35f-18b5-4497-b521-33e61aa861da None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:02.817377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e35f-18b5-4497-b521-33e61aa861da None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:02.826342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 282/561] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:02.827498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2e35f-18b5-4497-b521-33e61aa861da None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:02.951738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a62eff-8f74-47f0-8819-0232d6ca9b01 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:02.983322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2e35f-18b5-4497-b521-33e61aa861da None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:03.032558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c472b-715e-4ab8-a03f-edcd865bd941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:03.036260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c472b-715e-4ab8-a03f-edcd865bd941 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.036260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c472b-715e-4ab8-a03f-edcd865bd941 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.036260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c472b-715e-4ab8-a03f-edcd865bd941 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.040167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d7bd0-548a-43f3-9214-7f8683f4fbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:03.041387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d7bd0-548a-43f3-9214-7f8683f4fbf4 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.041854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d7bd0-548a-43f3-9214-7f8683f4fbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.042391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d7bd0-548a-43f3-9214-7f8683f4fbf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.051151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c472b-715e-4ab8-a03f-edcd865bd941 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:03.054033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c472b-715e-4ab8-a03f-edcd865bd941 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:03.061878 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d7bd0-548a-43f3-9214-7f8683f4fbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:03.063424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d7bd0-548a-43f3-9214-7f8683f4fbf4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:03.082625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-2e0d7bd0-548a-43f3-9214-7f8683f4fbf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:03.082921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-733c472b-715e-4ab8-a03f-edcd865bd941 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:03.090243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 283/562] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:03.090486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 280/563] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:03.090486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7989e-9635-4736-9331-705402c6d9f3 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.090486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7989e-9635-4736-9331-705402c6d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.090486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7989e-9635-4736-9331-705402c6d9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.090924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d7bd0-548a-43f3-9214-7f8683f4fbf4 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:03.126906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-eae7989e-9635-4736-9331-705402c6d9f3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:03.129004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-eae7989e-9635-4736-9331-705402c6d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:03.241991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 281/564] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:03.241991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7989e-9635-4736-9331-705402c6d9f3 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:03.311922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d7bd0-548a-43f3-9214-7f8683f4fbf4 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:03.351772 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf666d4-7c68-4f3e-9fec-8edbd5351dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:03.352591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf666d4-7c68-4f3e-9fec-8edbd5351dde None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.352868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf666d4-7c68-4f3e-9fec-8edbd5351dde None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.353137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf666d4-7c68-4f3e-9fec-8edbd5351dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.364902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf666d4-7c68-4f3e-9fec-8edbd5351dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:03.366460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf666d4-7c68-4f3e-9fec-8edbd5351dde None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:03.385179 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-ebf666d4-7c68-4f3e-9fec-8edbd5351dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:03.386480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 284/565] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:03.387277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf666d4-7c68-4f3e-9fec-8edbd5351dde None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:03.415153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7989e-9635-4736-9331-705402c6d9f3 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:03.462797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5e7b-ac6b-4a16-b89d-a6ae5dbc8fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:03.463696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5e7b-ac6b-4a16-b89d-a6ae5dbc8fb3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.463972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5e7b-ac6b-4a16-b89d-a6ae5dbc8fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.464239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5e7b-ac6b-4a16-b89d-a6ae5dbc8fb3 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.465060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef5e7b-ac6b-4a16-b89d-a6ae5dbc8fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:03.465376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef5e7b-ac6b-4a16-b89d-a6ae5dbc8fb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:03.467035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef5e7b-ac6b-4a16-b89d-a6ae5dbc8fb3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:03.480062 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 282/566] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:03.480935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5e7b-ac6b-4a16-b89d-a6ae5dbc8fb3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:03.510755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf666d4-7c68-4f3e-9fec-8edbd5351dde None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:03.558109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de3144-2584-423e-8d68-56b13ec4496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:03.558921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de3144-2584-423e-8d68-56b13ec4496d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.559387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de3144-2584-423e-8d68-56b13ec4496d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.559753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de3144-2584-423e-8d68-56b13ec4496d None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.560749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de3144-2584-423e-8d68-56b13ec4496d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:03.561123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de3144-2584-423e-8d68-56b13ec4496d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:03.562801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de3144-2584-423e-8d68-56b13ec4496d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:03.576732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 285/567] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:03.579175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d73c3-beaa-4170-81c5-450962a178ac None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.579658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d73c3-beaa-4170-81c5-450962a178ac None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.580150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d73c3-beaa-4170-81c5-450962a178ac None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.583695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 286/568] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:03.584820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d73c3-beaa-4170-81c5-450962a178ac None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:03.617307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5e7b-ac6b-4a16-b89d-a6ae5dbc8fb3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:03.666338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5a1fc-2ea0-4c16-91b0-bae9e2edde08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:03.667277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5a1fc-2ea0-4c16-91b0-bae9e2edde08 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.667651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5a1fc-2ea0-4c16-91b0-bae9e2edde08 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.667999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5a1fc-2ea0-4c16-91b0-bae9e2edde08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.681755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5a1fc-2ea0-4c16-91b0-bae9e2edde08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:03.692682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-0af5a1fc-2ea0-4c16-91b0-bae9e2edde08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:03.693951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 283/569] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:03.696730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5a1fc-2ea0-4c16-91b0-bae9e2edde08 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:03.696919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d73c3-beaa-4170-81c5-450962a178ac None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:03.733736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e24e1-28a5-4aab-a78e-be9ae47b1ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:03.734445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e24e1-28a5-4aab-a78e-be9ae47b1ad1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.734723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e24e1-28a5-4aab-a78e-be9ae47b1ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.735000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e24e1-28a5-4aab-a78e-be9ae47b1ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.735737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e24e1-28a5-4aab-a78e-be9ae47b1ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:03.736046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e24e1-28a5-4aab-a78e-be9ae47b1ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:03.737767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e24e1-28a5-4aab-a78e-be9ae47b1ad1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:03.750919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 287/570] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:03.751797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e24e1-28a5-4aab-a78e-be9ae47b1ad1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:03.843363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5a1fc-2ea0-4c16-91b0-bae9e2edde08 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:03.875338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e24e1-28a5-4aab-a78e-be9ae47b1ad1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:03.894636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c52d-89ce-4057-93ab-54320cf2099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:03.895675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c52d-89ce-4057-93ab-54320cf2099d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.896121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c52d-89ce-4057-93ab-54320cf2099d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.896567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c52d-89ce-4057-93ab-54320cf2099d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.898027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c52d-89ce-4057-93ab-54320cf2099d None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=439b41be395d4faeae0b855a1e0f25f1) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:03.898575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c52d-89ce-4057-93ab-54320cf2099d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:03.901043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c52d-89ce-4057-93ab-54320cf2099d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:03.916580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 284/571] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:03 2022] GET /identity/v3/role_assignments?user.id=439b41be395d4faeae0b855a1e0f25f1&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:03.916580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577b8af-08a1-448a-8539-5dc20df71e41 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.916580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577b8af-08a1-448a-8539-5dc20df71e41 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.916580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577b8af-08a1-448a-8539-5dc20df71e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.936782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0989342-9c6b-464d-98f7-366dce0372e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:03.940106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0989342-9c6b-464d-98f7-366dce0372e4 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:03.940598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0989342-9c6b-464d-98f7-366dce0372e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:03.941012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0989342-9c6b-464d-98f7-366dce0372e4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:03.943139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-9577b8af-08a1-448a-8539-5dc20df71e41 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:03.945448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9577b8af-08a1-448a-8539-5dc20df71e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:03.955027 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0989342-9c6b-464d-98f7-366dce0372e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:03.957492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0989342-9c6b-464d-98f7-366dce0372e4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:03.982541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-d0989342-9c6b-464d-98f7-366dce0372e4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 22 19:40:03.992633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 288/572] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:03.992633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0989342-9c6b-464d-98f7-366dce0372e4 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:04.063062 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 285/573] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:04.065687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577b8af-08a1-448a-8539-5dc20df71e41 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:04.174727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0989342-9c6b-464d-98f7-366dce0372e4 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:04.232535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719b9ec-137a-41ca-aaae-49c88fb2bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:04.234200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719b9ec-137a-41ca-aaae-49c88fb2bafe None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:04.234973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719b9ec-137a-41ca-aaae-49c88fb2bafe None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:04.235708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719b9ec-137a-41ca-aaae-49c88fb2bafe None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:04.237336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719b9ec-137a-41ca-aaae-49c88fb2bafe None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:04.238178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719b9ec-137a-41ca-aaae-49c88fb2bafe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:04.241063 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719b9ec-137a-41ca-aaae-49c88fb2bafe None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:04.241357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577b8af-08a1-448a-8539-5dc20df71e41 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:04.262149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 289/574] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:04.262149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719b9ec-137a-41ca-aaae-49c88fb2bafe None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:04.295198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf01755-5f69-46ac-be2d-bb690c282988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:04.296532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf01755-5f69-46ac-be2d-bb690c282988 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:04.297003 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf01755-5f69-46ac-be2d-bb690c282988 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:04.297449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf01755-5f69-46ac-be2d-bb690c282988 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:04.307776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf01755-5f69-46ac-be2d-bb690c282988 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:04.309774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf01755-5f69-46ac-be2d-bb690c282988 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:04.333246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-acf01755-5f69-46ac-be2d-bb690c282988 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 22 19:40:04.335681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 286/575] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Mar 22 19:40:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:04.337274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf01755-5f69-46ac-be2d-bb690c282988 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:04.415130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719b9ec-137a-41ca-aaae-49c88fb2bafe None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:04.470307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23086107-7f8e-4cba-9dcd-16ee4de82cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:04.471010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23086107-7f8e-4cba-9dcd-16ee4de82cf8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:04.471357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23086107-7f8e-4cba-9dcd-16ee4de82cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:04.471697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23086107-7f8e-4cba-9dcd-16ee4de82cf8 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:04.472768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23086107-7f8e-4cba-9dcd-16ee4de82cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:04.473637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23086107-7f8e-4cba-9dcd-16ee4de82cf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:04.476220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23086107-7f8e-4cba-9dcd-16ee4de82cf8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:04.507143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf01755-5f69-46ac-be2d-bb690c282988 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:04.514931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 290/576] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Mar 22 19:40:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:04.514931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23086107-7f8e-4cba-9dcd-16ee4de82cf8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:04.565065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac08fe-dae8-4afd-b530-3316713f15ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:04.566156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac08fe-dae8-4afd-b530-3316713f15ed None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:04.566626 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac08fe-dae8-4afd-b530-3316713f15ed None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:04.567076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac08fe-dae8-4afd-b530-3316713f15ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:04.586305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac08fe-dae8-4afd-b530-3316713f15ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:04.599426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-57ac08fe-dae8-4afd-b530-3316713f15ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:04.602258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 287/577] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:04.603913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac08fe-dae8-4afd-b530-3316713f15ed None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:04.647224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23086107-7f8e-4cba-9dcd-16ee4de82cf8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:04.689274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c115f6-6133-4c7b-b8eb-593652eb6a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:04.690218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c115f6-6133-4c7b-b8eb-593652eb6a94 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:04.690497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c115f6-6133-4c7b-b8eb-593652eb6a94 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:04.690768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c115f6-6133-4c7b-b8eb-593652eb6a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:04.708556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c115f6-6133-4c7b-b8eb-593652eb6a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:04.711198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c115f6-6133-4c7b-b8eb-593652eb6a94 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:04.740907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-f6c115f6-6133-4c7b-b8eb-593652eb6a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:04.749382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 291/578] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:04.749382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c115f6-6133-4c7b-b8eb-593652eb6a94 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:04.764043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac08fe-dae8-4afd-b530-3316713f15ed None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:04.804478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5b1e-ffe0-4cdd-85a7-5b65caf61d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:04.805623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5b1e-ffe0-4cdd-85a7-5b65caf61d68 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:04.805927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5b1e-ffe0-4cdd-85a7-5b65caf61d68 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:04.806193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5b1e-ffe0-4cdd-85a7-5b65caf61d68 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:04.807058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e5b1e-ffe0-4cdd-85a7-5b65caf61d68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:04.807366 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e5b1e-ffe0-4cdd-85a7-5b65caf61d68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:04.808852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e5b1e-ffe0-4cdd-85a7-5b65caf61d68 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:04.839316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 288/579] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Mar 22 19:40:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:04.841295 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5b1e-ffe0-4cdd-85a7-5b65caf61d68 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:04.899567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c115f6-6133-4c7b-b8eb-593652eb6a94 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:04.962873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714783d-973f-4b14-8e1f-3b9555a02fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:04.964254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714783d-973f-4b14-8e1f-3b9555a02fa2 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:04.964745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714783d-973f-4b14-8e1f-3b9555a02fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:04.965244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714783d-973f-4b14-8e1f-3b9555a02fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:04.978167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5b1e-ffe0-4cdd-85a7-5b65caf61d68 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:04.986318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714783d-973f-4b14-8e1f-3b9555a02fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:04.989178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714783d-973f-4b14-8e1f-3b9555a02fa2 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.022476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-5714783d-973f-4b14-8e1f-3b9555a02fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:05.024078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac6802-7e05-491e-b87a-aaba3826d8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:05.030323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 292/580] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:05.030611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac6802-7e05-491e-b87a-aaba3826d8d3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:05.030611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac6802-7e05-491e-b87a-aaba3826d8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:05.030611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac6802-7e05-491e-b87a-aaba3826d8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:05.031041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714783d-973f-4b14-8e1f-3b9555a02fa2 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:05.031186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac6802-7e05-491e-b87a-aaba3826d8d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:05.031186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac6802-7e05-491e-b87a-aaba3826d8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:05.031186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac6802-7e05-491e-b87a-aaba3826d8d3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.044123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 289/581] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:05.045068 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac6802-7e05-491e-b87a-aaba3826d8d3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:05.188294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac6802-7e05-491e-b87a-aaba3826d8d3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:05.190279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714783d-973f-4b14-8e1f-3b9555a02fa2 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:05.237318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8eb07-ec32-4418-8e92-d54d8f741e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:05.238019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8eb07-ec32-4418-8e92-d54d8f741e0c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:05.238293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8eb07-ec32-4418-8e92-d54d8f741e0c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:05.238570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8eb07-ec32-4418-8e92-d54d8f741e0c None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:05.238891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b237564-25b3-49e5-a984-09356c688821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:05.239294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8eb07-ec32-4418-8e92-d54d8f741e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:05.239593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8eb07-ec32-4418-8e92-d54d8f741e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:05.240232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b237564-25b3-49e5-a984-09356c688821 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:05.240721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b237564-25b3-49e5-a984-09356c688821 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:05.240986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8eb07-ec32-4418-8e92-d54d8f741e0c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.241232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b237564-25b3-49e5-a984-09356c688821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:05.256790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b237564-25b3-49e5-a984-09356c688821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:05.258250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b237564-25b3-49e5-a984-09356c688821 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.267782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 293/582] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:05.267782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8eb07-ec32-4418-8e92-d54d8f741e0c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:05.276494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-0b237564-25b3-49e5-a984-09356c688821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:05.277927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 290/583] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:05.278499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b237564-25b3-49e5-a984-09356c688821 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:05.409864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b237564-25b3-49e5-a984-09356c688821 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:05.411792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8eb07-ec32-4418-8e92-d54d8f741e0c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:05.444815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540fd8c-e68c-4676-9a5f-ea40368b0ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:05.446101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540fd8c-e68c-4676-9a5f-ea40368b0ea6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:05.446412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540fd8c-e68c-4676-9a5f-ea40368b0ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:05.446642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540fd8c-e68c-4676-9a5f-ea40368b0ea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:05.456323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f9578-ed83-4f4a-ad6d-6e0a2cff8373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:05.457001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9578-ed83-4f4a-ad6d-6e0a2cff8373 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:05.457282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9578-ed83-4f4a-ad6d-6e0a2cff8373 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:05.457550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9578-ed83-4f4a-ad6d-6e0a2cff8373 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:05.458317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f9578-ed83-4f4a-ad6d-6e0a2cff8373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:05.458620 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f9578-ed83-4f4a-ad6d-6e0a2cff8373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:05.459058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540fd8c-e68c-4676-9a5f-ea40368b0ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:05.460046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f9578-ed83-4f4a-ad6d-6e0a2cff8373 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.460515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540fd8c-e68c-4676-9a5f-ea40368b0ea6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.477867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 294/584] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:05.478883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-9540fd8c-e68c-4676-9a5f-ea40368b0ea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:05.480174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f9578-ed83-4f4a-ad6d-6e0a2cff8373 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:05.484517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 291/585] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:05.485443 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540fd8c-e68c-4676-9a5f-ea40368b0ea6 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:05.612953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f9578-ed83-4f4a-ad6d-6e0a2cff8373 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:05.613631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540fd8c-e68c-4676-9a5f-ea40368b0ea6 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:05.650578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93722c06-026a-4483-a6b8-09b30b6a86d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:05.651418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93722c06-026a-4483-a6b8-09b30b6a86d6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:05.651698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93722c06-026a-4483-a6b8-09b30b6a86d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:05.651968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93722c06-026a-4483-a6b8-09b30b6a86d6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:05.660401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93722c06-026a-4483-a6b8-09b30b6a86d6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:05.662135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93722c06-026a-4483-a6b8-09b30b6a86d6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.663448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f0fb-1a68-4c8f-9fd1-81d3e60ebb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:05.664684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f0fb-1a68-4c8f-9fd1-81d3e60ebb2b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:05.665173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f0fb-1a68-4c8f-9fd1-81d3e60ebb2b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:05.665668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f0fb-1a68-4c8f-9fd1-81d3e60ebb2b None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:05.667091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156f0fb-1a68-4c8f-9fd1-81d3e60ebb2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:05.667637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156f0fb-1a68-4c8f-9fd1-81d3e60ebb2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:05.670342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156f0fb-1a68-4c8f-9fd1-81d3e60ebb2b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.676918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-93722c06-026a-4483-a6b8-09b30b6a86d6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 22 19:40:05.683589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 295/586] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:05.683589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93722c06-026a-4483-a6b8-09b30b6a86d6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:05.690156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 292/587] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:05.691354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f0fb-1a68-4c8f-9fd1-81d3e60ebb2b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:05.806491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93722c06-026a-4483-a6b8-09b30b6a86d6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:05.815439 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f0fb-1a68-4c8f-9fd1-81d3e60ebb2b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:05.856741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af5db-6c09-4dd6-bead-1a4728b998cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:05.858020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af5db-6c09-4dd6-bead-1a4728b998cf None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:05.858520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af5db-6c09-4dd6-bead-1a4728b998cf None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:05.858947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af5db-6c09-4dd6-bead-1a4728b998cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:05.866435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f8a5d-74ef-4633-83a6-38bfdb5b0c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:05.868066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f8a5d-74ef-4633-83a6-38bfdb5b0c5c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:05.869582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f8a5d-74ef-4633-83a6-38bfdb5b0c5c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:05.869582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f8a5d-74ef-4633-83a6-38bfdb5b0c5c None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:05.870298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f8a5d-74ef-4633-83a6-38bfdb5b0c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:05.870556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0af5db-6c09-4dd6-bead-1a4728b998cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:05.870788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f8a5d-74ef-4633-83a6-38bfdb5b0c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:05.872981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0af5db-6c09-4dd6-bead-1a4728b998cf None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.873114 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f8a5d-74ef-4633-83a6-38bfdb5b0c5c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:05.895383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-6c0af5db-6c09-4dd6-bead-1a4728b998cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:05.897071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 296/588] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:05.898588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af5db-6c09-4dd6-bead-1a4728b998cf None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:05.903971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 293/589] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:05.905798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f8a5d-74ef-4633-83a6-38bfdb5b0c5c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:06.049735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af5db-6c09-4dd6-bead-1a4728b998cf None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.053506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f8a5d-74ef-4633-83a6-38bfdb5b0c5c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.109137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b17d-6ed0-4e90-b26d-e152420edb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:06.110411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b17d-6ed0-4e90-b26d-e152420edb98 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.110802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b17d-6ed0-4e90-b26d-e152420edb98 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.111253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b17d-6ed0-4e90-b26d-e152420edb98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.112560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d96ed-424a-450e-bc8d-6f3b9c00db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:06.113674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d96ed-424a-450e-bc8d-6f3b9c00db9c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.114152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d96ed-424a-450e-bc8d-6f3b9c00db9c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.114590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d96ed-424a-450e-bc8d-6f3b9c00db9c None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.115924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d96ed-424a-450e-bc8d-6f3b9c00db9c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:06.116370 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d96ed-424a-450e-bc8d-6f3b9c00db9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:06.118146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d96ed-424a-450e-bc8d-6f3b9c00db9c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:06.123820 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978b17d-6ed0-4e90-b26d-e152420edb98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:06.126598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978b17d-6ed0-4e90-b26d-e152420edb98 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:06.144220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 297/590] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:06.144220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d96ed-424a-450e-bc8d-6f3b9c00db9c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:06.154991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-c978b17d-6ed0-4e90-b26d-e152420edb98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:06.162079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 294/591] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:06.162079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b17d-6ed0-4e90-b26d-e152420edb98 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:06.291479 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d96ed-424a-450e-bc8d-6f3b9c00db9c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.333434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b17d-6ed0-4e90-b26d-e152420edb98 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.341556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea29fa-4c8c-4164-8aa5-9386104270c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:06.342318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea29fa-4c8c-4164-8aa5-9386104270c6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.342554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea29fa-4c8c-4164-8aa5-9386104270c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.342824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea29fa-4c8c-4164-8aa5-9386104270c6 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.343594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea29fa-4c8c-4164-8aa5-9386104270c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:06.343899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea29fa-4c8c-4164-8aa5-9386104270c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:06.345357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea29fa-4c8c-4164-8aa5-9386104270c6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:06.362902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 298/592] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:06.365117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea29fa-4c8c-4164-8aa5-9386104270c6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:06.382365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de90d3-c5f8-4e65-b33c-b7917289ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:06.383224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de90d3-c5f8-4e65-b33c-b7917289ae5b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.383555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de90d3-c5f8-4e65-b33c-b7917289ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.383898 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de90d3-c5f8-4e65-b33c-b7917289ae5b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.392129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de90d3-c5f8-4e65-b33c-b7917289ae5b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:06.393632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de90d3-c5f8-4e65-b33c-b7917289ae5b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:06.408800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-07de90d3-c5f8-4e65-b33c-b7917289ae5b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 22 19:40:06.417981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 295/593] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:06.417981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de90d3-c5f8-4e65-b33c-b7917289ae5b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:06.507290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea29fa-4c8c-4164-8aa5-9386104270c6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.544269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3169-9794-4669-86d9-072ba31cf8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:06.545080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3169-9794-4669-86d9-072ba31cf8d6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.545358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3169-9794-4669-86d9-072ba31cf8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.545623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3169-9794-4669-86d9-072ba31cf8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.557438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3169-9794-4669-86d9-072ba31cf8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:06.558980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3169-9794-4669-86d9-072ba31cf8d6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:06.566305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de90d3-c5f8-4e65-b33c-b7917289ae5b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.577272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-48ca3169-9794-4669-86d9-072ba31cf8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:06.578835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 299/594] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:06.579347 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3169-9794-4669-86d9-072ba31cf8d6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:06.615583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28768c-bb15-412c-a45b-071bdd1c89c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:06.616402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28768c-bb15-412c-a45b-071bdd1c89c4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.616763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28768c-bb15-412c-a45b-071bdd1c89c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.617225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28768c-bb15-412c-a45b-071bdd1c89c4 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.618642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28768c-bb15-412c-a45b-071bdd1c89c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:06.619059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28768c-bb15-412c-a45b-071bdd1c89c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:06.620767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28768c-bb15-412c-a45b-071bdd1c89c4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:06.634065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 296/595] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:06.635004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28768c-bb15-412c-a45b-071bdd1c89c4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:06.709310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3169-9794-4669-86d9-072ba31cf8d6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.750473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6121-0ec8-45e9-8c57-96d486f2b008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:06.750763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28768c-bb15-412c-a45b-071bdd1c89c4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.751623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6121-0ec8-45e9-8c57-96d486f2b008 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.751998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6121-0ec8-45e9-8c57-96d486f2b008 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.752376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6121-0ec8-45e9-8c57-96d486f2b008 None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/02aff559435a445db07636197a534f4c/roles/5a4466ef1a5f41b795e229b997885f2e` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.770394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6121-0ec8-45e9-8c57-96d486f2b008 None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=02aff559435a445db07636197a534f4c, role_id=5a4466ef1a5f41b795e229b997885f2e)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:06.772124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6121-0ec8-45e9-8c57-96d486f2b008 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:06.786947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 300/596] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:40:06 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/02aff559435a445db07636197a534f4c/roles/5a4466ef1a5f41b795e229b997885f2e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:40:06.788498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3731ca0-6dfe-4d15-86fe-da94d9075243 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.788808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3731ca0-6dfe-4d15-86fe-da94d9075243 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.789047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3731ca0-6dfe-4d15-86fe-da94d9075243 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.791234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 301/597] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:06.792495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf50b5-2338-41d2-942a-ab5c3007379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:06.793372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf50b5-2338-41d2-942a-ab5c3007379d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.793806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf50b5-2338-41d2-942a-ab5c3007379d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.794261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf50b5-2338-41d2-942a-ab5c3007379d None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.795787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf50b5-2338-41d2-942a-ab5c3007379d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:06.795960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf50b5-2338-41d2-942a-ab5c3007379d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:06.796439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3731ca0-6dfe-4d15-86fe-da94d9075243 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:06.798052 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf50b5-2338-41d2-942a-ab5c3007379d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:06.825023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 297/598] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Mar 22 19:40:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:06.825318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf50b5-2338-41d2-942a-ab5c3007379d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:06.936206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3731ca0-6dfe-4d15-86fe-da94d9075243 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.953378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf50b5-2338-41d2-942a-ab5c3007379d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:06.979757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b93da-43ee-40ae-b87b-b80ed2ca6322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:06.980443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b93da-43ee-40ae-b87b-b80ed2ca6322 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.980719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b93da-43ee-40ae-b87b-b80ed2ca6322 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.980985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b93da-43ee-40ae-b87b-b80ed2ca6322 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:06.981723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b93da-43ee-40ae-b87b-b80ed2ca6322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:06.982134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b93da-43ee-40ae-b87b-b80ed2ca6322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:06.983557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b93da-43ee-40ae-b87b-b80ed2ca6322 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:06.997832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 302/599] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:06.999237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acbcb-0748-4e06-affe-705fe7c9e438 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:06.999563 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acbcb-0748-4e06-affe-705fe7c9e438 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:06.999792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87acbcb-0748-4e06-affe-705fe7c9e438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:07.008951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a500e3-6287-4a0a-81ea-60ff87d1cd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:07.010263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a500e3-6287-4a0a-81ea-60ff87d1cd7c None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:07.010739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a500e3-6287-4a0a-81ea-60ff87d1cd7c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:07.011231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a500e3-6287-4a0a-81ea-60ff87d1cd7c None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/7f74d49fc68344899f70efb85eb1c97d/roles/5a4466ef1a5f41b795e229b997885f2e` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:07.018734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b87acbcb-0748-4e06-affe-705fe7c9e438 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:07.020010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b87acbcb-0748-4e06-affe-705fe7c9e438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:07.032690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a500e3-6287-4a0a-81ea-60ff87d1cd7c None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=7f74d49fc68344899f70efb85eb1c97d, role_id=5a4466ef1a5f41b795e229b997885f2e)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:07.035626 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a500e3-6287-4a0a-81ea-60ff87d1cd7c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:07.054075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 298/600] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:40:06 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/7f74d49fc68344899f70efb85eb1c97d/roles/5a4466ef1a5f41b795e229b997885f2e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:40:07.055059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a500e3-6287-4a0a-81ea-60ff87d1cd7c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:07.123191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 303/601] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:07.124184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87acbcb-0748-4e06-affe-705fe7c9e438 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:07.195654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a500e3-6287-4a0a-81ea-60ff87d1cd7c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:07.259225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b19895-e2de-422b-bad0-7fb67ada935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:07.260889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b19895-e2de-422b-bad0-7fb67ada935c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:07.261665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87acbcb-0748-4e06-affe-705fe7c9e438 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:07.263356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b19895-e2de-422b-bad0-7fb67ada935c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:07.266755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b19895-e2de-422b-bad0-7fb67ada935c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:07.289643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b19895-e2de-422b-bad0-7fb67ada935c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:07.292699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b19895-e2de-422b-bad0-7fb67ada935c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:07.303491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15385320-3ff9-4ddd-8fac-2408e8eb1e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:07.305301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15385320-3ff9-4ddd-8fac-2408e8eb1e9d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:07.305883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15385320-3ff9-4ddd-8fac-2408e8eb1e9d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:07.306417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15385320-3ff9-4ddd-8fac-2408e8eb1e9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:07.316270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15385320-3ff9-4ddd-8fac-2408e8eb1e9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:07.318273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15385320-3ff9-4ddd-8fac-2408e8eb1e9d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:07.328753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-f4b19895-e2de-422b-bad0-7fb67ada935c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:07.336244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 299/602] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:07.336244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b19895-e2de-422b-bad0-7fb67ada935c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:07.340802 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-15385320-3ff9-4ddd-8fac-2408e8eb1e9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:07.342806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 304/603] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:07.343942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15385320-3ff9-4ddd-8fac-2408e8eb1e9d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:07.468291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15385320-3ff9-4ddd-8fac-2408e8eb1e9d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:07.508080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e81f5c-1b7c-4e95-a54f-44039529256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:07.509186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e81f5c-1b7c-4e95-a54f-44039529256b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:07.509779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e81f5c-1b7c-4e95-a54f-44039529256b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:07.510306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e81f5c-1b7c-4e95-a54f-44039529256b None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:07.511291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e81f5c-1b7c-4e95-a54f-44039529256b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:07.511810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e81f5c-1b7c-4e95-a54f-44039529256b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:07.513472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e81f5c-1b7c-4e95-a54f-44039529256b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:07.528728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 305/604] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:07.534639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e81f5c-1b7c-4e95-a54f-44039529256b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:07.539839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b19895-e2de-422b-bad0-7fb67ada935c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:07.605073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d61a3-61e9-487d-9690-f45912e781ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:07.606496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d61a3-61e9-487d-9690-f45912e781ee None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:07.606939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d61a3-61e9-487d-9690-f45912e781ee None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:07.607357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d61a3-61e9-487d-9690-f45912e781ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:07.638612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d61a3-61e9-487d-9690-f45912e781ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:07.652010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-729d61a3-61e9-487d-9690-f45912e781ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:07.654162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e81f5c-1b7c-4e95-a54f-44039529256b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:07.654701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 300/605] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:07.656168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d61a3-61e9-487d-9690-f45912e781ee None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:07.693554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811de547-1d8b-44a8-b4ba-386f4bf36e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:07.694686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de547-1d8b-44a8-b4ba-386f4bf36e96 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:07.695288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de547-1d8b-44a8-b4ba-386f4bf36e96 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:07.695781 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de547-1d8b-44a8-b4ba-386f4bf36e96 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:07.696908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811de547-1d8b-44a8-b4ba-386f4bf36e96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:07.697444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811de547-1d8b-44a8-b4ba-386f4bf36e96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:07.699892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811de547-1d8b-44a8-b4ba-386f4bf36e96 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:07.721303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 306/606] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:07.723976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811de547-1d8b-44a8-b4ba-386f4bf36e96 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:07.843085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d61a3-61e9-487d-9690-f45912e781ee None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:07.859038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811de547-1d8b-44a8-b4ba-386f4bf36e96 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:07.901025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba751-c063-44d8-ad07-10572d52f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:07.902118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba751-c063-44d8-ad07-10572d52f811 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:07.902598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba751-c063-44d8-ad07-10572d52f811 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:07.903096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba751-c063-44d8-ad07-10572d52f811 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:07.904073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fba751-c063-44d8-ad07-10572d52f811 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:07.904573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fba751-c063-44d8-ad07-10572d52f811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:07.904768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539ced6-bb72-483e-911b-66ca9d09a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:07.906242 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539ced6-bb72-483e-911b-66ca9d09a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:07.906650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fba751-c063-44d8-ad07-10572d52f811 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:07.906761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539ced6-bb72-483e-911b-66ca9d09a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:07.907235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539ced6-bb72-483e-911b-66ca9d09a0f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:07.917321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 307/607] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:07.918862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba751-c063-44d8-ad07-10572d52f811 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:07.919767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539ced6-bb72-483e-911b-66ca9d09a0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:07.922579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539ced6-bb72-483e-911b-66ca9d09a0f5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:07.950444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-f539ced6-bb72-483e-911b-66ca9d09a0f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:07.957456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 301/608] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:07.957456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539ced6-bb72-483e-911b-66ca9d09a0f5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:08.045568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba751-c063-44d8-ad07-10572d52f811 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:08.108818 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539ced6-bb72-483e-911b-66ca9d09a0f5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:08.110108 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794ae2c-77f0-474f-ac6b-cf58b5af99ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:08.113158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ae2c-77f0-474f-ac6b-cf58b5af99ae None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:08.113662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ae2c-77f0-474f-ac6b-cf58b5af99ae None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:08.114206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ae2c-77f0-474f-ac6b-cf58b5af99ae None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/c2e837368cdc4df29d945a4c8e662a94/roles/5a4466ef1a5f41b795e229b997885f2e` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:08.148633 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a118dd-c591-438b-8f17-e748e5a6aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:08.149918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794ae2c-77f0-474f-ac6b-cf58b5af99ae None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=c2e837368cdc4df29d945a4c8e662a94, role_id=5a4466ef1a5f41b795e229b997885f2e)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:08.150667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a118dd-c591-438b-8f17-e748e5a6aac7 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:08.151151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a118dd-c591-438b-8f17-e748e5a6aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:08.151646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a118dd-c591-438b-8f17-e748e5a6aac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:08.152502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794ae2c-77f0-474f-ac6b-cf58b5af99ae None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:08.167840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a118dd-c591-438b-8f17-e748e5a6aac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:08.167840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a118dd-c591-438b-8f17-e748e5a6aac7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:08.189988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b7a118dd-c591-438b-8f17-e748e5a6aac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:08.190696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 308/609] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:40:07 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/c2e837368cdc4df29d945a4c8e662a94/roles/5a4466ef1a5f41b795e229b997885f2e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:40:08.192021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 302/610] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:08.192323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794ae2c-77f0-474f-ac6b-cf58b5af99ae None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:08.200656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a118dd-c591-438b-8f17-e748e5a6aac7 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:08.425554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794ae2c-77f0-474f-ac6b-cf58b5af99ae None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:08.470208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7d394-455e-484f-ad8b-18efd643b71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:08.471312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7d394-455e-484f-ad8b-18efd643b71e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:08.471826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7d394-455e-484f-ad8b-18efd643b71e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:08.472288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7d394-455e-484f-ad8b-18efd643b71e None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:08.473642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7d394-455e-484f-ad8b-18efd643b71e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:08.474356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7d394-455e-484f-ad8b-18efd643b71e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:08.476022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7d394-455e-484f-ad8b-18efd643b71e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:08.477051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a118dd-c591-438b-8f17-e748e5a6aac7 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:08.497346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 309/611] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:08.503050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7d394-455e-484f-ad8b-18efd643b71e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:08.540621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def487a-50cb-4882-9a6a-8275f7d6752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:08.541322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def487a-50cb-4882-9a6a-8275f7d6752d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:08.541604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def487a-50cb-4882-9a6a-8275f7d6752d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:08.541880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def487a-50cb-4882-9a6a-8275f7d6752d None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:08.542710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def487a-50cb-4882-9a6a-8275f7d6752d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:08.543017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def487a-50cb-4882-9a6a-8275f7d6752d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:08.544513 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def487a-50cb-4882-9a6a-8275f7d6752d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:08.558659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 303/612] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:08.579536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def487a-50cb-4882-9a6a-8275f7d6752d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:08.681456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7d394-455e-484f-ad8b-18efd643b71e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:08.746143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5165ef8-09e6-43cc-ad83-36cda93dab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:08.747849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5165ef8-09e6-43cc-ad83-36cda93dab5e None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:08.748296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5165ef8-09e6-43cc-ad83-36cda93dab5e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:08.748588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5165ef8-09e6-43cc-ad83-36cda93dab5e None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/908e60013ebe4372a803a2ae5223e2c6/roles/5a4466ef1a5f41b795e229b997885f2e` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:08.777419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5165ef8-09e6-43cc-ad83-36cda93dab5e None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=908e60013ebe4372a803a2ae5223e2c6, role_id=5a4466ef1a5f41b795e229b997885f2e)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:08.780193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5165ef8-09e6-43cc-ad83-36cda93dab5e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:08.817183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 310/613] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:40:08 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/908e60013ebe4372a803a2ae5223e2c6/roles/5a4466ef1a5f41b795e229b997885f2e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:40:08.841636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def487a-50cb-4882-9a6a-8275f7d6752d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:08.906079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37c31d-ded8-45c6-bbfd-d54c19bda09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:08.907539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37c31d-ded8-45c6-bbfd-d54c19bda09f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:08.908034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37c31d-ded8-45c6-bbfd-d54c19bda09f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:08.908529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37c31d-ded8-45c6-bbfd-d54c19bda09f None admin] PATH_INFO: `/v3/users/swift` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:08.925287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37c31d-ded8-45c6-bbfd-d54c19bda09f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:08.928078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37c31d-ded8-45c6-bbfd-d54c19bda09f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:08.951337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-9a37c31d-ded8-45c6-bbfd-d54c19bda09f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 22 19:40:08.953019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 304/614] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:08.962429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5165ef8-09e6-43cc-ad83-36cda93dab5e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:09.091261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5165ef8-09e6-43cc-ad83-36cda93dab5e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:09.127822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4eefb-fac0-4402-8d61-45d44cfa683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:09.128529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4eefb-fac0-4402-8d61-45d44cfa683e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:09.128806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4eefb-fac0-4402-8d61-45d44cfa683e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:09.129077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4eefb-fac0-4402-8d61-45d44cfa683e None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:09.129920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4eefb-fac0-4402-8d61-45d44cfa683e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:09.130251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4eefb-fac0-4402-8d61-45d44cfa683e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:09.131688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4eefb-fac0-4402-8d61-45d44cfa683e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:09.152280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 311/615] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Mar 22 19:40:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:09.163147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37c31d-ded8-45c6-bbfd-d54c19bda09f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:09.281458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37c31d-ded8-45c6-bbfd-d54c19bda09f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:09.327280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d412e-8921-45c0-8f40-68b2f196b6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:09.328113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d412e-8921-45c0-8f40-68b2f196b6b4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:09.328410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d412e-8921-45c0-8f40-68b2f196b6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:09.328656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d412e-8921-45c0-8f40-68b2f196b6b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:09.346347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d412e-8921-45c0-8f40-68b2f196b6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:09.347816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d412e-8921-45c0-8f40-68b2f196b6b4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:09.371618 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-7e4d412e-8921-45c0-8f40-68b2f196b6b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:09.373231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 305/616] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:09.381429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4eefb-fac0-4402-8d61-45d44cfa683e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:09.524870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4eefb-fac0-4402-8d61-45d44cfa683e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:09.569718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c7559-d9ef-4985-9e7b-82fe8b1ffda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:09.570701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c7559-d9ef-4985-9e7b-82fe8b1ffda4 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:09.571017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c7559-d9ef-4985-9e7b-82fe8b1ffda4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:09.571279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c7559-d9ef-4985-9e7b-82fe8b1ffda4 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:09.572025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c7559-d9ef-4985-9e7b-82fe8b1ffda4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:09.572329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c7559-d9ef-4985-9e7b-82fe8b1ffda4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:09.573735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c7559-d9ef-4985-9e7b-82fe8b1ffda4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:09.592435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 312/617] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:09.603107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d412e-8921-45c0-8f40-68b2f196b6b4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:09.724901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d412e-8921-45c0-8f40-68b2f196b6b4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:09.765541 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac75bb2-7361-4be2-b6ff-34f5f989ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:09.766397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac75bb2-7361-4be2-b6ff-34f5f989ea56 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:09.766674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac75bb2-7361-4be2-b6ff-34f5f989ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:09.766951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac75bb2-7361-4be2-b6ff-34f5f989ea56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:09.775118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac75bb2-7361-4be2-b6ff-34f5f989ea56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:09.776634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac75bb2-7361-4be2-b6ff-34f5f989ea56 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:09.791414 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-4ac75bb2-7361-4be2-b6ff-34f5f989ea56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:09.793030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 306/618] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:09.801480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c7559-d9ef-4985-9e7b-82fe8b1ffda4 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:09.959079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c7559-d9ef-4985-9e7b-82fe8b1ffda4 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:10.001595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c66ea4-1662-47d6-80aa-cf433a5da7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:10.002310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c66ea4-1662-47d6-80aa-cf433a5da7db None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:10.002587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c66ea4-1662-47d6-80aa-cf433a5da7db None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:10.002861 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c66ea4-1662-47d6-80aa-cf433a5da7db None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:10.003663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c66ea4-1662-47d6-80aa-cf433a5da7db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:10.003975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c66ea4-1662-47d6-80aa-cf433a5da7db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:10.005454 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c66ea4-1662-47d6-80aa-cf433a5da7db None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:10.024540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 313/619] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:10.035112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac75bb2-7361-4be2-b6ff-34f5f989ea56 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:10.169864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac75bb2-7361-4be2-b6ff-34f5f989ea56 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:10.217911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c13b03-7b8d-4458-9090-960adf03e354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:10.218916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c13b03-7b8d-4458-9090-960adf03e354 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:10.219198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c13b03-7b8d-4458-9090-960adf03e354 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:10.219476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c13b03-7b8d-4458-9090-960adf03e354 None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/439b41be395d4faeae0b855a1e0f25f1/roles/5a4466ef1a5f41b795e229b997885f2e` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:10.243216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c13b03-7b8d-4458-9090-960adf03e354 None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=439b41be395d4faeae0b855a1e0f25f1, role_id=5a4466ef1a5f41b795e229b997885f2e)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:10.244989 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c13b03-7b8d-4458-9090-960adf03e354 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:10.270612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 307/620] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:40:10 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/439b41be395d4faeae0b855a1e0f25f1/roles/5a4466ef1a5f41b795e229b997885f2e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:40:10.845884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a187bc-7cb1-4247-8575-7896259e6d19 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:10.846870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a187bc-7cb1-4247-8575-7896259e6d19 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:10.846870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a187bc-7cb1-4247-8575-7896259e6d19 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:10.848871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 314/621] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:10.854589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84020c9-9175-4551-9f49-728b4f78a223 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:10.855487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84020c9-9175-4551-9f49-728b4f78a223 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:10.855487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84020c9-9175-4551-9f49-728b4f78a223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:10.879029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d84020c9-9175-4551-9f49-728b4f78a223 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:10.880448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d84020c9-9175-4551-9f49-728b4f78a223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:10.965425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad59f6-b4e0-43d6-87ab-c593eef1375e None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:10.965916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad59f6-b4e0-43d6-87ab-c593eef1375e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:10.966439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad59f6-b4e0-43d6-87ab-c593eef1375e None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:10.971721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 308/623] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:10.978051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 315/623] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:10.986448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735cfb5-28d7-492f-a8e4-9ff6fdf32453 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:10.986835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735cfb5-28d7-492f-a8e4-9ff6fdf32453 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:10.987071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735cfb5-28d7-492f-a8e4-9ff6fdf32453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:10.999669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad59f6-b4e0-43d6-87ab-c593eef1375e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:11.015163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-0735cfb5-28d7-492f-a8e4-9ff6fdf32453 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:11.016379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0735cfb5-28d7-492f-a8e4-9ff6fdf32453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:11.127265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 309/624] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:11.150961 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735cfb5-28d7-492f-a8e4-9ff6fdf32453 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:11.191600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad59f6-b4e0-43d6-87ab-c593eef1375e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:11.263665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af51c8-1c22-45f9-a34f-1da20eb0d40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:11.264488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af51c8-1c22-45f9-a34f-1da20eb0d40f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:11.264766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af51c8-1c22-45f9-a34f-1da20eb0d40f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:11.265037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af51c8-1c22-45f9-a34f-1da20eb0d40f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:11.290379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af51c8-1c22-45f9-a34f-1da20eb0d40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:11.297475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-e7af51c8-1c22-45f9-a34f-1da20eb0d40f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:11.315591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 316/625] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:11.315591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af51c8-1c22-45f9-a34f-1da20eb0d40f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:11.344212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735cfb5-28d7-492f-a8e4-9ff6fdf32453 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:11.381479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c81261-c249-4f90-a7c1-7a1666ee3954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:11.382251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c81261-c249-4f90-a7c1-7a1666ee3954 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:11.382610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c81261-c249-4f90-a7c1-7a1666ee3954 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:11.382902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c81261-c249-4f90-a7c1-7a1666ee3954 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:11.397976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c81261-c249-4f90-a7c1-7a1666ee3954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:11.401763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b5c81261-c249-4f90-a7c1-7a1666ee3954 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:11.403370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 310/626] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:11.409162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c81261-c249-4f90-a7c1-7a1666ee3954 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:11.548321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c81261-c249-4f90-a7c1-7a1666ee3954 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:11.582130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af51c8-1c22-45f9-a34f-1da20eb0d40f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:11.600219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc4b4-8fd9-47cc-b6ec-a3ba7bbbfefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:11.600909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc4b4-8fd9-47cc-b6ec-a3ba7bbbfefc None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:11.601240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc4b4-8fd9-47cc-b6ec-a3ba7bbbfefc None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:11.601500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc4b4-8fd9-47cc-b6ec-a3ba7bbbfefc None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:11.602700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc4b4-8fd9-47cc-b6ec-a3ba7bbbfefc None admin] RBAC: Adding query filter params (name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:11.603010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc4b4-8fd9-47cc-b6ec-a3ba7bbbfefc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:11.605063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc4b4-8fd9-47cc-b6ec-a3ba7bbbfefc None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:11.615730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 311/627] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:11.621127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc4b4-8fd9-47cc-b6ec-a3ba7bbbfefc None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:11.687486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86659ca-94d8-47fa-bd8f-aebf685e7e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:11.688544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86659ca-94d8-47fa-bd8f-aebf685e7e11 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:11.689012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86659ca-94d8-47fa-bd8f-aebf685e7e11 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:11.689466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86659ca-94d8-47fa-bd8f-aebf685e7e11 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:11.690476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86659ca-94d8-47fa-bd8f-aebf685e7e11 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:11.690999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86659ca-94d8-47fa-bd8f-aebf685e7e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:11.692612 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86659ca-94d8-47fa-bd8f-aebf685e7e11 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:11.710749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 317/628] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:11.715823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86659ca-94d8-47fa-bd8f-aebf685e7e11 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:11.737045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc4b4-8fd9-47cc-b6ec-a3ba7bbbfefc None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:11.794955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17be334-7328-4bb5-99bd-dd8be04f4a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:11.796289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17be334-7328-4bb5-99bd-dd8be04f4a83 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:11.796773 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17be334-7328-4bb5-99bd-dd8be04f4a83 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:11.797236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17be334-7328-4bb5-99bd-dd8be04f4a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:11.817660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17be334-7328-4bb5-99bd-dd8be04f4a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:11.820197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17be334-7328-4bb5-99bd-dd8be04f4a83 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:11.860452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86659ca-94d8-47fa-bd8f-aebf685e7e11 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:11.867559 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a17be334-7328-4bb5-99bd-dd8be04f4a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:11.871052 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 312/629] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:11.872987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5971001-6a5e-4f5d-a69d-34ac7984b8d9 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:11.873481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5971001-6a5e-4f5d-a69d-34ac7984b8d9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:11.874245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5971001-6a5e-4f5d-a69d-34ac7984b8d9 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:11.878184 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 313/630] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:11.879760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5971001-6a5e-4f5d-a69d-34ac7984b8d9 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:11.906662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea52c33-af7d-419f-b5e6-d46d872cf967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:11.908121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea52c33-af7d-419f-b5e6-d46d872cf967 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:11.909192 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea52c33-af7d-419f-b5e6-d46d872cf967 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:11.909715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea52c33-af7d-419f-b5e6-d46d872cf967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:11.924806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea52c33-af7d-419f-b5e6-d46d872cf967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:11.927012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea52c33-af7d-419f-b5e6-d46d872cf967 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:11.950008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-4ea52c33-af7d-419f-b5e6-d46d872cf967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:11.952069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 318/631] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:11.954426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513061-fd29-47e4-a1e7-37cc3246a0ad None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:11.955001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513061-fd29-47e4-a1e7-37cc3246a0ad None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:11.955478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0513061-fd29-47e4-a1e7-37cc3246a0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:11.977422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c0513061-fd29-47e4-a1e7-37cc3246a0ad None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:11.981525 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c0513061-fd29-47e4-a1e7-37cc3246a0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:12.074851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 319/632] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:12.076319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0513061-fd29-47e4-a1e7-37cc3246a0ad None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:12.088126 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5971001-6a5e-4f5d-a69d-34ac7984b8d9 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.134672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d0a32-5cc6-4deb-b7be-32cb61892591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:12.135051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d0a32-5cc6-4deb-b7be-32cb61892591 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.135213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d0a32-5cc6-4deb-b7be-32cb61892591 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.135468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d0a32-5cc6-4deb-b7be-32cb61892591 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.136223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d0a32-5cc6-4deb-b7be-32cb61892591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:12.136526 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d0a32-5cc6-4deb-b7be-32cb61892591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:12.138001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d0a32-5cc6-4deb-b7be-32cb61892591 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:12.152122 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 314/633] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:12.152632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d0a32-5cc6-4deb-b7be-32cb61892591 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:12.222053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0513061-fd29-47e4-a1e7-37cc3246a0ad None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.268439 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d0a32-5cc6-4deb-b7be-32cb61892591 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.272734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28fca4-0490-4c71-a78e-eb9c11a3e46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:12.274022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28fca4-0490-4c71-a78e-eb9c11a3e46d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.274525 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28fca4-0490-4c71-a78e-eb9c11a3e46d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.274987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28fca4-0490-4c71-a78e-eb9c11a3e46d None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.275945 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28fca4-0490-4c71-a78e-eb9c11a3e46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:12.276446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28fca4-0490-4c71-a78e-eb9c11a3e46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:12.278817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28fca4-0490-4c71-a78e-eb9c11a3e46d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:12.296528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 320/634] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:12.297978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28fca4-0490-4c71-a78e-eb9c11a3e46d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:12.310696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab4ed-4b7b-4251-bdf1-fb1dd7fd02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:12.312480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab4ed-4b7b-4251-bdf1-fb1dd7fd02f0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.313380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab4ed-4b7b-4251-bdf1-fb1dd7fd02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.314066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab4ed-4b7b-4251-bdf1-fb1dd7fd02f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.330753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ab4ed-4b7b-4251-bdf1-fb1dd7fd02f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:12.341540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-452ab4ed-4b7b-4251-bdf1-fb1dd7fd02f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:12.343265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 315/635] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:12.344317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab4ed-4b7b-4251-bdf1-fb1dd7fd02f0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:12.419441 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28fca4-0490-4c71-a78e-eb9c11a3e46d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.454981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ea135-e38d-4722-bd9c-eabac6242086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:12.455800 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ea135-e38d-4722-bd9c-eabac6242086 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.456079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ea135-e38d-4722-bd9c-eabac6242086 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.456350 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ea135-e38d-4722-bd9c-eabac6242086 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.464854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ea135-e38d-4722-bd9c-eabac6242086 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:12.466403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ea135-e38d-4722-bd9c-eabac6242086 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:12.468173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab4ed-4b7b-4251-bdf1-fb1dd7fd02f0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.481931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-722ea135-e38d-4722-bd9c-eabac6242086 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 22 19:40:12.483239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 321/636] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:12.484041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ea135-e38d-4722-bd9c-eabac6242086 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:12.513393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001313e-459f-4c18-adb6-cc5e00551222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:12.514246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001313e-459f-4c18-adb6-cc5e00551222 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.514529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001313e-459f-4c18-adb6-cc5e00551222 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.514807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001313e-459f-4c18-adb6-cc5e00551222 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.523422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001313e-459f-4c18-adb6-cc5e00551222 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:12.524824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001313e-459f-4c18-adb6-cc5e00551222 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:12.539583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b001313e-459f-4c18-adb6-cc5e00551222 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 22 19:40:12.546254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 316/637] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:12.546254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4f56-14b4-47ee-8ff5-9729b476157b None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.546254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4f56-14b4-47ee-8ff5-9729b476157b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.546254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4f56-14b4-47ee-8ff5-9729b476157b None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.546254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 317/638] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:12.546254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4f56-14b4-47ee-8ff5-9729b476157b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:12.607732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ea135-e38d-4722-bd9c-eabac6242086 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.641803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35043fe7-77b9-4896-8e8c-40a086253905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:12.642518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35043fe7-77b9-4896-8e8c-40a086253905 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.642796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35043fe7-77b9-4896-8e8c-40a086253905 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.643067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35043fe7-77b9-4896-8e8c-40a086253905 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.643819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35043fe7-77b9-4896-8e8c-40a086253905 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:12.644122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35043fe7-77b9-4896-8e8c-40a086253905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:12.645512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35043fe7-77b9-4896-8e8c-40a086253905 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:12.649143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4f56-14b4-47ee-8ff5-9729b476157b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.659913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 322/639] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:12.659913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6347-5309-49a6-a6cd-6c876ad65823 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.659913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6347-5309-49a6-a6cd-6c876ad65823 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.659913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6347-5309-49a6-a6cd-6c876ad65823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.676835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-fe5e6347-5309-49a6-a6cd-6c876ad65823 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:12.678067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-fe5e6347-5309-49a6-a6cd-6c876ad65823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:12.684067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a8f21-8d4c-4e3d-8c6e-73b2d5603133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:12.684757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a8f21-8d4c-4e3d-8c6e-73b2d5603133 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.685037 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a8f21-8d4c-4e3d-8c6e-73b2d5603133 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.685312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a8f21-8d4c-4e3d-8c6e-73b2d5603133 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.686205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a8f21-8d4c-4e3d-8c6e-73b2d5603133 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:12.686479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a8f21-8d4c-4e3d-8c6e-73b2d5603133 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:12.687956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a8f21-8d4c-4e3d-8c6e-73b2d5603133 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:12.707191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 318/640] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:12.708503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a8f21-8d4c-4e3d-8c6e-73b2d5603133 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:12.767228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 323/641] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:12.768526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e6347-5309-49a6-a6cd-6c876ad65823 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:12.812394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a8f21-8d4c-4e3d-8c6e-73b2d5603133 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.847012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cbb96-a680-41ba-9d9d-251d4074b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:12.847697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cbb96-a680-41ba-9d9d-251d4074b324 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.847977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cbb96-a680-41ba-9d9d-251d4074b324 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.848580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cbb96-a680-41ba-9d9d-251d4074b324 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.849461 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cbb96-a680-41ba-9d9d-251d4074b324 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:12.849740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cbb96-a680-41ba-9d9d-251d4074b324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:12.851364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cbb96-a680-41ba-9d9d-251d4074b324 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:12.873825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 319/642] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:12.873825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cbb96-a680-41ba-9d9d-251d4074b324 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:12.895820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e6347-5309-49a6-a6cd-6c876ad65823 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.939418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d78df-2542-43e6-8437-e32ff2f21495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:12.940218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d78df-2542-43e6-8437-e32ff2f21495 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:12.940497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d78df-2542-43e6-8437-e32ff2f21495 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:12.940752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d78df-2542-43e6-8437-e32ff2f21495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:12.953009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d78df-2542-43e6-8437-e32ff2f21495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:12.954533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d78df-2542-43e6-8437-e32ff2f21495 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:12.978557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cbb96-a680-41ba-9d9d-251d4074b324 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:12.982231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a84d78df-2542-43e6-8437-e32ff2f21495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:12.989388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 324/643] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:12.989388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d78df-2542-43e6-8437-e32ff2f21495 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:13.013674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8833607-0661-4699-ad34-2be17f73d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:13.014369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8833607-0661-4699-ad34-2be17f73d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:13.014650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8833607-0661-4699-ad34-2be17f73d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:13.014926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8833607-0661-4699-ad34-2be17f73d5b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:13.102378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8833607-0661-4699-ad34-2be17f73d5b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:13.105055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8833607-0661-4699-ad34-2be17f73d5b0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:13.119921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d78df-2542-43e6-8437-e32ff2f21495 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:13.157192 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db729d4f-1910-4f9f-afec-1ef064d822b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:13.158060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db729d4f-1910-4f9f-afec-1ef064d822b3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:13.158344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db729d4f-1910-4f9f-afec-1ef064d822b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:13.158620 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db729d4f-1910-4f9f-afec-1ef064d822b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:13.171593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db729d4f-1910-4f9f-afec-1ef064d822b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:13.180254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-db729d4f-1910-4f9f-afec-1ef064d822b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:13.187843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 325/644] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:13.187843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db729d4f-1910-4f9f-afec-1ef064d822b3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:13.248701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 320/645] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:40:13.249893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8833607-0661-4699-ad34-2be17f73d5b0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:13.317782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db729d4f-1910-4f9f-afec-1ef064d822b3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:13.364763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58433d-d87c-4c2a-be81-f1407850f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:13.365597 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58433d-d87c-4c2a-be81-f1407850f040 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:13.366117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58433d-d87c-4c2a-be81-f1407850f040 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:13.366591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58433d-d87c-4c2a-be81-f1407850f040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:13.373732 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8833607-0661-4699-ad34-2be17f73d5b0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:13.416845 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe94678-b969-4f8b-8420-0c92bcbbdddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:13.417883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe94678-b969-4f8b-8420-0c92bcbbdddd None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:13.418465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe94678-b969-4f8b-8420-0c92bcbbdddd None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:13.418911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe94678-b969-4f8b-8420-0c92bcbbdddd None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:13.420029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe94678-b969-4f8b-8420-0c92bcbbdddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:13.420534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe94678-b969-4f8b-8420-0c92bcbbdddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:13.423239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe94678-b969-4f8b-8420-0c92bcbbdddd None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:13.445852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 321/646] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:13.445852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe94678-b969-4f8b-8420-0c92bcbbdddd None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:13.467473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58433d-d87c-4c2a-be81-f1407850f040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:13.469408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58433d-d87c-4c2a-be81-f1407850f040 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:13.572770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe94678-b969-4f8b-8420-0c92bcbbdddd None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:13.606494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 326/647] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:40:13.607082 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58433d-d87c-4c2a-be81-f1407850f040 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:13.620353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cc352-6488-4e7b-9f72-c2ecd1121aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:13.621484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc352-6488-4e7b-9f72-c2ecd1121aa6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:13.622082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc352-6488-4e7b-9f72-c2ecd1121aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:13.622533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc352-6488-4e7b-9f72-c2ecd1121aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:13.623891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cc352-6488-4e7b-9f72-c2ecd1121aa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:13.624445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cc352-6488-4e7b-9f72-c2ecd1121aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:13.626865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cc352-6488-4e7b-9f72-c2ecd1121aa6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:13.639371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 322/648] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:13.640855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cc352-6488-4e7b-9f72-c2ecd1121aa6 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:13.715019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58433d-d87c-4c2a-be81-f1407850f040 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:13.754209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cacc3-314f-49a3-a943-5c609f02963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:13.755776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cacc3-314f-49a3-a943-5c609f02963e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:13.755776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cacc3-314f-49a3-a943-5c609f02963e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:13.755776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cacc3-314f-49a3-a943-5c609f02963e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:13.767721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cc352-6488-4e7b-9f72-c2ecd1121aa6 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:13.770836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cacc3-314f-49a3-a943-5c609f02963e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:13.772335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cacc3-314f-49a3-a943-5c609f02963e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:13.792476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-2d4cacc3-314f-49a3-a943-5c609f02963e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:13.800528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 327/649] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:13.800528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d267159-3263-4e82-80e8-4988175c5ea8 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:13.800528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d267159-3263-4e82-80e8-4988175c5ea8 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:13.800528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d267159-3263-4e82-80e8-4988175c5ea8 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:13.800528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 328/650] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:13.800528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d267159-3263-4e82-80e8-4988175c5ea8 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:13.812191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b49fe-1f03-400e-a2a5-5d5caae5e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:13.813446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b49fe-1f03-400e-a2a5-5d5caae5e347 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:13.813891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b49fe-1f03-400e-a2a5-5d5caae5e347 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:13.814370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b49fe-1f03-400e-a2a5-5d5caae5e347 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:13.827106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b49fe-1f03-400e-a2a5-5d5caae5e347 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:13.829605 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b49fe-1f03-400e-a2a5-5d5caae5e347 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:13.855016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-6f3b49fe-1f03-400e-a2a5-5d5caae5e347 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 22 19:40:13.856360 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 323/651] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:13.857275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b49fe-1f03-400e-a2a5-5d5caae5e347 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:13.945197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d267159-3263-4e82-80e8-4988175c5ea8 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:13.997363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b49fe-1f03-400e-a2a5-5d5caae5e347 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:13.999553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ceccc5-e2c2-49bc-aa6e-2dce99b8e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.000829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceccc5-e2c2-49bc-aa6e-2dce99b8e978 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.001275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceccc5-e2c2-49bc-aa6e-2dce99b8e978 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.001724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceccc5-e2c2-49bc-aa6e-2dce99b8e978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.014096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ceccc5-e2c2-49bc-aa6e-2dce99b8e978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:14.015582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ceccc5-e2c2-49bc-aa6e-2dce99b8e978 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:14.034208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-d3ceccc5-e2c2-49bc-aa6e-2dce99b8e978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:14.035576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 329/652] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:14.036382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ceccc5-e2c2-49bc-aa6e-2dce99b8e978 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:14.039644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e760042-806c-4c06-972d-4d9ee3b0b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.040876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760042-806c-4c06-972d-4d9ee3b0b554 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.041323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760042-806c-4c06-972d-4d9ee3b0b554 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.041743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760042-806c-4c06-972d-4d9ee3b0b554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.053739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e760042-806c-4c06-972d-4d9ee3b0b554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:14.055837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e760042-806c-4c06-972d-4d9ee3b0b554 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:14.075893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-2e760042-806c-4c06-972d-4d9ee3b0b554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:14.077444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 324/653] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:14.079657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b5c1-7cde-4d34-84cf-4d11731cbec5 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.080135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b5c1-7cde-4d34-84cf-4d11731cbec5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.080634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b5c1-7cde-4d34-84cf-4d11731cbec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.105230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7a33b5c1-7cde-4d34-84cf-4d11731cbec5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:14.106991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7a33b5c1-7cde-4d34-84cf-4d11731cbec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:14.179012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ceccc5-e2c2-49bc-aa6e-2dce99b8e978 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:14.204196 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 325/654] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:14.205465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b5c1-7cde-4d34-84cf-4d11731cbec5 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:14.230752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14f99b-54f9-482d-832e-3277fa63b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.231940 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14f99b-54f9-482d-832e-3277fa63b306 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.232451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14f99b-54f9-482d-832e-3277fa63b306 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.232938 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14f99b-54f9-482d-832e-3277fa63b306 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.234354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14f99b-54f9-482d-832e-3277fa63b306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:14.234915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14f99b-54f9-482d-832e-3277fa63b306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:14.237522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14f99b-54f9-482d-832e-3277fa63b306 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:14.253051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 330/655] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:14.254258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14f99b-54f9-482d-832e-3277fa63b306 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:14.339982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b5c1-7cde-4d34-84cf-4d11731cbec5 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:14.378956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b604880-f826-4b06-bf2b-9b42f57f040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.379745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b604880-f826-4b06-bf2b-9b42f57f040e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.380093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b604880-f826-4b06-bf2b-9b42f57f040e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.380432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b604880-f826-4b06-bf2b-9b42f57f040e None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.381493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b604880-f826-4b06-bf2b-9b42f57f040e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:14.381867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b604880-f826-4b06-bf2b-9b42f57f040e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:14.384393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b604880-f826-4b06-bf2b-9b42f57f040e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:14.386594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14f99b-54f9-482d-832e-3277fa63b306 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:14.406483 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 326/656] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Mar 22 19:40:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:14.407465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b604880-f826-4b06-bf2b-9b42f57f040e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:14.428963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc67a44-af95-472d-8e0e-57a15e2f17f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.429846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc67a44-af95-472d-8e0e-57a15e2f17f0 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.430279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc67a44-af95-472d-8e0e-57a15e2f17f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.430665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc67a44-af95-472d-8e0e-57a15e2f17f0 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.431537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc67a44-af95-472d-8e0e-57a15e2f17f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:14.431949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc67a44-af95-472d-8e0e-57a15e2f17f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:14.433506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc67a44-af95-472d-8e0e-57a15e2f17f0 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:14.447980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 331/657] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:14.449040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc67a44-af95-472d-8e0e-57a15e2f17f0 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:14.529365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b604880-f826-4b06-bf2b-9b42f57f040e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:14.570707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc67a44-af95-472d-8e0e-57a15e2f17f0 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:14.571789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083143-e511-4649-910d-93980365be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.572531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083143-e511-4649-910d-93980365be29 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.572871 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083143-e511-4649-910d-93980365be29 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.573258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083143-e511-4649-910d-93980365be29 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.574143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f083143-e511-4649-910d-93980365be29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:14.574553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f083143-e511-4649-910d-93980365be29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:14.576090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f083143-e511-4649-910d-93980365be29 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:14.589051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 327/658] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:14.590594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083143-e511-4649-910d-93980365be29 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:14.612409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570a302-e0a9-4bdf-9189-20aac18f607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.613380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a302-e0a9-4bdf-9189-20aac18f607e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.613749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a302-e0a9-4bdf-9189-20aac18f607e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.614172 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a302-e0a9-4bdf-9189-20aac18f607e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.626707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570a302-e0a9-4bdf-9189-20aac18f607e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:14.640161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-2570a302-e0a9-4bdf-9189-20aac18f607e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:14.641614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 332/659] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:14.642945 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570a302-e0a9-4bdf-9189-20aac18f607e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:14.700694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083143-e511-4649-910d-93980365be29 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:14.735968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb36f0-0deb-45e8-8491-7cdd1a32c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.736783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb36f0-0deb-45e8-8491-7cdd1a32c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.737064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb36f0-0deb-45e8-8491-7cdd1a32c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.737338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb36f0-0deb-45e8-8491-7cdd1a32c9b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.744915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb36f0-0deb-45e8-8491-7cdd1a32c9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:14.746435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb36f0-0deb-45e8-8491-7cdd1a32c9b4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:14.761413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-eebb36f0-0deb-45e8-8491-7cdd1a32c9b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:14.762750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 328/660] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:14.763558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb36f0-0deb-45e8-8491-7cdd1a32c9b4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:14.813076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570a302-e0a9-4bdf-9189-20aac18f607e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:14.860239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaf218-3e75-42d9-8164-39d7f13fa721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.860989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf218-3e75-42d9-8164-39d7f13fa721 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.861346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf218-3e75-42d9-8164-39d7f13fa721 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.861685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf218-3e75-42d9-8164-39d7f13fa721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.890836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb36f0-0deb-45e8-8491-7cdd1a32c9b4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:14.927958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db930a5-4652-4d0a-9fc8-64a76b1ae7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:14.928915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db930a5-4652-4d0a-9fc8-64a76b1ae7a0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:14.929358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db930a5-4652-4d0a-9fc8-64a76b1ae7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:14.929718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db930a5-4652-4d0a-9fc8-64a76b1ae7a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:14.935822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaf218-3e75-42d9-8164-39d7f13fa721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:14.937303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaf218-3e75-42d9-8164-39d7f13fa721 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:14.938348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db930a5-4652-4d0a-9fc8-64a76b1ae7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:14.940013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db930a5-4652-4d0a-9fc8-64a76b1ae7a0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:14.955630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-1db930a5-4652-4d0a-9fc8-64a76b1ae7a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:14.956903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 329/661] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:14.957700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db930a5-4652-4d0a-9fc8-64a76b1ae7a0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.081017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 333/662] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:40:15.082339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaf218-3e75-42d9-8164-39d7f13fa721 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.100342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db930a5-4652-4d0a-9fc8-64a76b1ae7a0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:15.137095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce0143-4af4-412f-af95-ab3145d14352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:15.138408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce0143-4af4-412f-af95-ab3145d14352 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:15.138862 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce0143-4af4-412f-af95-ab3145d14352 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:15.139317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce0143-4af4-412f-af95-ab3145d14352 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:15.151728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce0143-4af4-412f-af95-ab3145d14352 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:15.154212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce0143-4af4-412f-af95-ab3145d14352 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:15.176824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-96ce0143-4af4-412f-af95-ab3145d14352 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 22 19:40:15.178840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 330/663] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:15.180013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce0143-4af4-412f-af95-ab3145d14352 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.216645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaf218-3e75-42d9-8164-39d7f13fa721 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:15.271687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87608b-ee18-4714-8901-be42f76423af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:15.272701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87608b-ee18-4714-8901-be42f76423af None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:15.273245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87608b-ee18-4714-8901-be42f76423af None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:15.274576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87608b-ee18-4714-8901-be42f76423af None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:15.275835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87608b-ee18-4714-8901-be42f76423af None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:15.276321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87608b-ee18-4714-8901-be42f76423af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:15.278873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87608b-ee18-4714-8901-be42f76423af None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:15.292780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 334/664] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:15.294264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87608b-ee18-4714-8901-be42f76423af None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.334328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce0143-4af4-412f-af95-ab3145d14352 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:15.375777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d061f27-d0aa-42b5-a3c5-f2a8df7d7756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:15.376846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d061f27-d0aa-42b5-a3c5-f2a8df7d7756 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:15.377296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d061f27-d0aa-42b5-a3c5-f2a8df7d7756 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:15.377737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d061f27-d0aa-42b5-a3c5-f2a8df7d7756 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:15.379162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d061f27-d0aa-42b5-a3c5-f2a8df7d7756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:15.380017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d061f27-d0aa-42b5-a3c5-f2a8df7d7756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:15.381446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d061f27-d0aa-42b5-a3c5-f2a8df7d7756 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:15.395688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 331/665] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:15.396565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d061f27-d0aa-42b5-a3c5-f2a8df7d7756 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.433195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87608b-ee18-4714-8901-be42f76423af None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:15.471211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643fe2-0620-4b9c-a190-95271533431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:15.471864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643fe2-0620-4b9c-a190-95271533431c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:15.472145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643fe2-0620-4b9c-a190-95271533431c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:15.472414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643fe2-0620-4b9c-a190-95271533431c None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:15.473210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20643fe2-0620-4b9c-a190-95271533431c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:15.473876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20643fe2-0620-4b9c-a190-95271533431c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:15.475373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20643fe2-0620-4b9c-a190-95271533431c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:15.489543 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 335/666] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:15.490430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643fe2-0620-4b9c-a190-95271533431c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.517560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d061f27-d0aa-42b5-a3c5-f2a8df7d7756 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:15.557888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbaeb4-f22e-4b48-ad0c-0f33c288c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:15.558890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbaeb4-f22e-4b48-ad0c-0f33c288c5ea None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:15.559327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbaeb4-f22e-4b48-ad0c-0f33c288c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:15.559702 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbaeb4-f22e-4b48-ad0c-0f33c288c5ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:15.572576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbaeb4-f22e-4b48-ad0c-0f33c288c5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:15.574099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbaeb4-f22e-4b48-ad0c-0f33c288c5ea None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:15.594579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b1bbaeb4-f22e-4b48-ad0c-0f33c288c5ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:15.596245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 332/667] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:15.597312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbaeb4-f22e-4b48-ad0c-0f33c288c5ea None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.604223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643fe2-0620-4b9c-a190-95271533431c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:15.654185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24853e0f-a5cd-476b-b146-bd673879c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:15.655343 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24853e0f-a5cd-476b-b146-bd673879c84a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:15.655826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24853e0f-a5cd-476b-b146-bd673879c84a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:15.656285 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24853e0f-a5cd-476b-b146-bd673879c84a None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:15.657887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24853e0f-a5cd-476b-b146-bd673879c84a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:15.658479 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24853e0f-a5cd-476b-b146-bd673879c84a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:15.661084 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24853e0f-a5cd-476b-b146-bd673879c84a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:15.692060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 336/668] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:15.693559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24853e0f-a5cd-476b-b146-bd673879c84a None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.708636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbaeb4-f22e-4b48-ad0c-0f33c288c5ea None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:15.765420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2138ae-3193-49cb-9c3f-e32d2b30c0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:15.766289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2138ae-3193-49cb-9c3f-e32d2b30c0a8 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:15.766577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2138ae-3193-49cb-9c3f-e32d2b30c0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:15.766857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2138ae-3193-49cb-9c3f-e32d2b30c0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:15.781886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2138ae-3193-49cb-9c3f-e32d2b30c0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:15.783744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2138ae-3193-49cb-9c3f-e32d2b30c0a8 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:15.802133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-0e2138ae-3193-49cb-9c3f-e32d2b30c0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:15.803437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 333/669] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:15.804286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2138ae-3193-49cb-9c3f-e32d2b30c0a8 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.839796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24853e0f-a5cd-476b-b146-bd673879c84a None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:15.895822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862b8d7-e50c-4e11-874e-020320b99e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:15.896701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b8d7-e50c-4e11-874e-020320b99e86 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:15.897120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b8d7-e50c-4e11-874e-020320b99e86 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:15.897538 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862b8d7-e50c-4e11-874e-020320b99e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:15.899033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862b8d7-e50c-4e11-874e-020320b99e86 None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=7f74d49fc68344899f70efb85eb1c97d) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:15.899550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862b8d7-e50c-4e11-874e-020320b99e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:15.902035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862b8d7-e50c-4e11-874e-020320b99e86 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:15.922287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 337/670] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/role_assignments?user.id=7f74d49fc68344899f70efb85eb1c97d&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:15.922287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862b8d7-e50c-4e11-874e-020320b99e86 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:15.928386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2138ae-3193-49cb-9c3f-e32d2b30c0a8 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:15.975979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd654f-2e8f-4249-8a76-6d74c06d310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:15.978092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd654f-2e8f-4249-8a76-6d74c06d310c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:15.978506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd654f-2e8f-4249-8a76-6d74c06d310c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:15.978907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd654f-2e8f-4249-8a76-6d74c06d310c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:15.980399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd654f-2e8f-4249-8a76-6d74c06d310c None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=02aff559435a445db07636197a534f4c) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:15.980880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd654f-2e8f-4249-8a76-6d74c06d310c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:15.983575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd654f-2e8f-4249-8a76-6d74c06d310c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:16.002355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 334/671] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/role_assignments?user.id=02aff559435a445db07636197a534f4c&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:16.002355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd654f-2e8f-4249-8a76-6d74c06d310c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:16.055405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862b8d7-e50c-4e11-874e-020320b99e86 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:16.096374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85471770-3c0d-4ddc-9ddc-5ca81b4f83c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:16.097420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85471770-3c0d-4ddc-9ddc-5ca81b4f83c4 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:16.097420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85471770-3c0d-4ddc-9ddc-5ca81b4f83c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:16.097664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85471770-3c0d-4ddc-9ddc-5ca81b4f83c4 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:16.098839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85471770-3c0d-4ddc-9ddc-5ca81b4f83c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:16.099975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85471770-3c0d-4ddc-9ddc-5ca81b4f83c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:16.100616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85471770-3c0d-4ddc-9ddc-5ca81b4f83c4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:16.115469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 338/672] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:16.121276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85471770-3c0d-4ddc-9ddc-5ca81b4f83c4 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:16.188364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd654f-2e8f-4249-8a76-6d74c06d310c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:16.242651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85471770-3c0d-4ddc-9ddc-5ca81b4f83c4 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:16.253045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102aa26-8494-41fb-890d-b11a22588fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:16.254405 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102aa26-8494-41fb-890d-b11a22588fce None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:16.254666 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102aa26-8494-41fb-890d-b11a22588fce None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:16.254939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102aa26-8494-41fb-890d-b11a22588fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:16.296064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537dcb8-d168-423a-86f5-325d42420601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:16.296749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537dcb8-d168-423a-86f5-325d42420601 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:16.297025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537dcb8-d168-423a-86f5-325d42420601 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:16.297293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537dcb8-d168-423a-86f5-325d42420601 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:16.298050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537dcb8-d168-423a-86f5-325d42420601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:16.298358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537dcb8-d168-423a-86f5-325d42420601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:16.299801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537dcb8-d168-423a-86f5-325d42420601 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:16.315964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 339/673] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:16.316876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537dcb8-d168-423a-86f5-325d42420601 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:16.381142 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102aa26-8494-41fb-890d-b11a22588fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:16.384173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102aa26-8494-41fb-890d-b11a22588fce None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:16.483841 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537dcb8-d168-423a-86f5-325d42420601 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:16.547629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e4689-0256-4a0d-aa09-fc1a06ca5527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:16.549066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e4689-0256-4a0d-aa09-fc1a06ca5527 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:16.549564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e4689-0256-4a0d-aa09-fc1a06ca5527 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:16.550204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e4689-0256-4a0d-aa09-fc1a06ca5527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:16.563758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e4689-0256-4a0d-aa09-fc1a06ca5527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:16.566729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e4689-0256-4a0d-aa09-fc1a06ca5527 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:16.592941 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-b71e4689-0256-4a0d-aa09-fc1a06ca5527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:16.600816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 340/675] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:16.600816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e4689-0256-4a0d-aa09-fc1a06ca5527 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:16.607112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 335/675] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:40:16.607825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102aa26-8494-41fb-890d-b11a22588fce None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:16.785134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102aa26-8494-41fb-890d-b11a22588fce None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:16.803471 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e4689-0256-4a0d-aa09-fc1a06ca5527 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:16.854952 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afa589-3a83-481e-9f43-d8841965fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:16.856093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afa589-3a83-481e-9f43-d8841965fe6c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:16.856576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afa589-3a83-481e-9f43-d8841965fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:16.857139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afa589-3a83-481e-9f43-d8841965fe6c None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:16.858974 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afa589-3a83-481e-9f43-d8841965fe6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:16.859132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afa589-3a83-481e-9f43-d8841965fe6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:16.861867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afa589-3a83-481e-9f43-d8841965fe6c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:16.867163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64321f-f276-42a5-8a0f-ceb286bfb7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:16.869216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64321f-f276-42a5-8a0f-ceb286bfb7d2 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:16.870012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64321f-f276-42a5-8a0f-ceb286bfb7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:16.870797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64321f-f276-42a5-8a0f-ceb286bfb7d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:16.881920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 336/676] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:16.883475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afa589-3a83-481e-9f43-d8841965fe6c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:16.887526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64321f-f276-42a5-8a0f-ceb286bfb7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:16.890599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64321f-f276-42a5-8a0f-ceb286bfb7d2 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:16.917033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-fb64321f-f276-42a5-8a0f-ceb286bfb7d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 22 19:40:16.920003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 341/677] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:16.921764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64321f-f276-42a5-8a0f-ceb286bfb7d2 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:17.062463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afa589-3a83-481e-9f43-d8841965fe6c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:17.107994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64321f-f276-42a5-8a0f-ceb286bfb7d2 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:17.124024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5d136-9878-4a61-9e5a-5dee286c75c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:17.125509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5d136-9878-4a61-9e5a-5dee286c75c0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:17.126060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5d136-9878-4a61-9e5a-5dee286c75c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:17.126625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5d136-9878-4a61-9e5a-5dee286c75c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:17.146332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5d136-9878-4a61-9e5a-5dee286c75c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:17.149043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5d136-9878-4a61-9e5a-5dee286c75c0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:17.175046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d08bd-f686-4a27-8a65-d774fb277212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:17.176475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d08bd-f686-4a27-8a65-d774fb277212 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:17.177132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d08bd-f686-4a27-8a65-d774fb277212 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:17.177823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d08bd-f686-4a27-8a65-d774fb277212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:17.180578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d08bd-f686-4a27-8a65-d774fb277212 None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=c2e837368cdc4df29d945a4c8e662a94) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:17.180798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-d0a5d136-9878-4a61-9e5a-5dee286c75c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:17.181732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d08bd-f686-4a27-8a65-d774fb277212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:17.190174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 337/678] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:17.190174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5d136-9878-4a61-9e5a-5dee286c75c0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:17.193258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d08bd-f686-4a27-8a65-d774fb277212 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:17.206838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 342/679] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:16 2022] GET /identity/v3/role_assignments?user.id=c2e837368cdc4df29d945a4c8e662a94&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:17.208932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d08bd-f686-4a27-8a65-d774fb277212 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:17.382786 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d08bd-f686-4a27-8a65-d774fb277212 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:17.417262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471afe7-44b7-44da-8936-a4a2e949bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:17.418562 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471afe7-44b7-44da-8936-a4a2e949bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:17.419198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471afe7-44b7-44da-8936-a4a2e949bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:17.419699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471afe7-44b7-44da-8936-a4a2e949bcb4 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:17.420686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471afe7-44b7-44da-8936-a4a2e949bcb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:17.421234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471afe7-44b7-44da-8936-a4a2e949bcb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:17.423055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471afe7-44b7-44da-8936-a4a2e949bcb4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:17.437145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 343/680] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:17.443225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471afe7-44b7-44da-8936-a4a2e949bcb4 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:17.448449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5d136-9878-4a61-9e5a-5dee286c75c0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:17.510118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df7aa5-86b3-4f94-9dae-ade2610d404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:17.510844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df7aa5-86b3-4f94-9dae-ade2610d404a None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:17.511194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df7aa5-86b3-4f94-9dae-ade2610d404a None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:17.511380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df7aa5-86b3-4f94-9dae-ade2610d404a None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:17.512330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df7aa5-86b3-4f94-9dae-ade2610d404a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:17.512653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df7aa5-86b3-4f94-9dae-ade2610d404a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:17.514202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df7aa5-86b3-4f94-9dae-ade2610d404a None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:17.551158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 338/681] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Mar 22 19:40:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:17.557246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df7aa5-86b3-4f94-9dae-ade2610d404a None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:17.561499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471afe7-44b7-44da-8936-a4a2e949bcb4 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:17.601440 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d921d8-1039-4434-8a2a-caccc3e0ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:17.602694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d921d8-1039-4434-8a2a-caccc3e0ce6c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:17.603217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d921d8-1039-4434-8a2a-caccc3e0ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:17.603706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d921d8-1039-4434-8a2a-caccc3e0ce6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:17.612341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d921d8-1039-4434-8a2a-caccc3e0ce6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:17.614220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d921d8-1039-4434-8a2a-caccc3e0ce6c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:17.628388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-d1d921d8-1039-4434-8a2a-caccc3e0ce6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:17.630388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 344/682] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:17.636942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d921d8-1039-4434-8a2a-caccc3e0ce6c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:17.679614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df7aa5-86b3-4f94-9dae-ade2610d404a None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:17.724579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a27c1-9c96-479d-892f-220676d63183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:17.725268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a27c1-9c96-479d-892f-220676d63183 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:17.725550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a27c1-9c96-479d-892f-220676d63183 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:17.725826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a27c1-9c96-479d-892f-220676d63183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:17.763147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d921d8-1039-4434-8a2a-caccc3e0ce6c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:17.816206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcc3cc-2bb3-432c-8ee1-b689ab5f4414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:17.818037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcc3cc-2bb3-432c-8ee1-b689ab5f4414 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:17.818853 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcc3cc-2bb3-432c-8ee1-b689ab5f4414 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:17.819669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcc3cc-2bb3-432c-8ee1-b689ab5f4414 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:17.821124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a27c1-9c96-479d-892f-220676d63183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:17.822646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a27c1-9c96-479d-892f-220676d63183 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:17.823025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcc3cc-2bb3-432c-8ee1-b689ab5f4414 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:17.823912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcc3cc-2bb3-432c-8ee1-b689ab5f4414 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:17.827028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcc3cc-2bb3-432c-8ee1-b689ab5f4414 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:17.853801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 345/683] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:17.859975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcc3cc-2bb3-432c-8ee1-b689ab5f4414 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:17.943465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 339/684] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 22 19:40:17.953024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a27c1-9c96-479d-892f-220676d63183 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:18.041258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcc3cc-2bb3-432c-8ee1-b689ab5f4414 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:18.073487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a27c1-9c96-479d-892f-220676d63183 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:18.100014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b84d9-416d-47b3-89fc-d2258eee0df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:18.102150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b84d9-416d-47b3-89fc-d2258eee0df8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:18.102941 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b84d9-416d-47b3-89fc-d2258eee0df8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:18.104682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b84d9-416d-47b3-89fc-d2258eee0df8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:18.109053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b84d9-416d-47b3-89fc-d2258eee0df8 None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=908e60013ebe4372a803a2ae5223e2c6) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:18.110764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b84d9-416d-47b3-89fc-d2258eee0df8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:18.112521 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254c700-21dd-4da6-954c-8a1b3e07648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:18.113343 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254c700-21dd-4da6-954c-8a1b3e07648f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:18.113632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254c700-21dd-4da6-954c-8a1b3e07648f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:18.113908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254c700-21dd-4da6-954c-8a1b3e07648f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:18.114865 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b84d9-416d-47b3-89fc-d2258eee0df8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:18.126625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254c700-21dd-4da6-954c-8a1b3e07648f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:18.127096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 346/685] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:17 2022] GET /identity/v3/role_assignments?user.id=908e60013ebe4372a803a2ae5223e2c6&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:18.128112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254c700-21dd-4da6-954c-8a1b3e07648f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:18.161191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b254c700-21dd-4da6-954c-8a1b3e07648f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:18.162899 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 340/686] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:18.172627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b84d9-416d-47b3-89fc-d2258eee0df8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:18.360957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b84d9-416d-47b3-89fc-d2258eee0df8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:18.408963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e46cfd-f230-4270-aad2-822c01ea448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:18.409638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e46cfd-f230-4270-aad2-822c01ea448d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:18.409910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e46cfd-f230-4270-aad2-822c01ea448d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:18.410232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e46cfd-f230-4270-aad2-822c01ea448d None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:18.410967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e46cfd-f230-4270-aad2-822c01ea448d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:18.411268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e46cfd-f230-4270-aad2-822c01ea448d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:18.412652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e46cfd-f230-4270-aad2-822c01ea448d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:18.428164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 347/687] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:18.438439 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254c700-21dd-4da6-954c-8a1b3e07648f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:18.636789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254c700-21dd-4da6-954c-8a1b3e07648f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:18.703548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b6b53-39e3-421f-b066-0cd2772a70ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:18.705404 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b6b53-39e3-421f-b066-0cd2772a70ae None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:18.706191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b6b53-39e3-421f-b066-0cd2772a70ae None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:18.706957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b6b53-39e3-421f-b066-0cd2772a70ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:18.720178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b6b53-39e3-421f-b066-0cd2772a70ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:18.723955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b6b53-39e3-421f-b066-0cd2772a70ae None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:18.751981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-118b6b53-39e3-421f-b066-0cd2772a70ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:18.759622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 341/688] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:18.763737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e46cfd-f230-4270-aad2-822c01ea448d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:18.949651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876274ef-81cc-458a-a10f-edfead2e6c72 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:18.950430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876274ef-81cc-458a-a10f-edfead2e6c72 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:18.950930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876274ef-81cc-458a-a10f-edfead2e6c72 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:18.953262 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 342/689] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:18.959151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba783aa-013d-4da7-af3e-19de123123f8 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:18.959770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba783aa-013d-4da7-af3e-19de123123f8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:18.960271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba783aa-013d-4da7-af3e-19de123123f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:18.999763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4ba783aa-013d-4da7-af3e-19de123123f8 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:19.001356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4ba783aa-013d-4da7-af3e-19de123123f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:19.016210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e46cfd-f230-4270-aad2-822c01ea448d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:19.083264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7510-ea01-4ccb-9bd2-4e5820d1662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:19.084405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7510-ea01-4ccb-9bd2-4e5820d1662d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:19.084887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7510-ea01-4ccb-9bd2-4e5820d1662d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:19.085373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7510-ea01-4ccb-9bd2-4e5820d1662d None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:19.087139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df7510-ea01-4ccb-9bd2-4e5820d1662d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:19.087668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df7510-ea01-4ccb-9bd2-4e5820d1662d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:19.090342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df7510-ea01-4ccb-9bd2-4e5820d1662d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:19.141555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 348/690] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:19.152501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7510-ea01-4ccb-9bd2-4e5820d1662d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:19.200474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 343/691] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:19.244129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba783aa-013d-4da7-af3e-19de123123f8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:19.304657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7510-ea01-4ccb-9bd2-4e5820d1662d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:19.342022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f704-638c-4b29-9898-2d0c01e776f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:19.343186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f704-638c-4b29-9898-2d0c01e776f5 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:19.343679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f704-638c-4b29-9898-2d0c01e776f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:19.344207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f704-638c-4b29-9898-2d0c01e776f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:19.345255 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220f704-638c-4b29-9898-2d0c01e776f5 None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=439b41be395d4faeae0b855a1e0f25f1) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:19.345776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220f704-638c-4b29-9898-2d0c01e776f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:19.347469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220f704-638c-4b29-9898-2d0c01e776f5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:19.362134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 349/692] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:19 2022] GET /identity/v3/role_assignments?user.id=439b41be395d4faeae0b855a1e0f25f1&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:19.508942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba783aa-013d-4da7-af3e-19de123123f8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:19.579356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ece43-0132-4f20-bbd9-91f56889a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:19.580743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ece43-0132-4f20-bbd9-91f56889a470 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:19.581238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ece43-0132-4f20-bbd9-91f56889a470 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:19.581736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ece43-0132-4f20-bbd9-91f56889a470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:19.602374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ece43-0132-4f20-bbd9-91f56889a470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:19.616932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-637ece43-0132-4f20-bbd9-91f56889a470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:40:19.619605 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 344/693] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:19.625037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f704-638c-4b29-9898-2d0c01e776f5 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:19.657157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4658cc-6449-44c2-8bbc-e85392c01c66 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:19.657781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4658cc-6449-44c2-8bbc-e85392c01c66 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:19.658508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4658cc-6449-44c2-8bbc-e85392c01c66 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:19.662432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 345/694] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:19.669817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc761b5-bfbb-46e0-85c6-7e997a997443 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:19.670395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc761b5-bfbb-46e0-85c6-7e997a997443 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:19.670854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc761b5-bfbb-46e0-85c6-7e997a997443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:19.690253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fcc761b5-bfbb-46e0-85c6-7e997a997443 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:19.691884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fcc761b5-bfbb-46e0-85c6-7e997a997443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:19.814799 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 346/695] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:40:19.828639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f704-638c-4b29-9898-2d0c01e776f5 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:19.860327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc761b5-bfbb-46e0-85c6-7e997a997443 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:19.897268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f0b82-7bc3-4dd5-bd08-d0df98aa20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:19.899412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f0b82-7bc3-4dd5-bd08-d0df98aa20c3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:19.900233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f0b82-7bc3-4dd5-bd08-d0df98aa20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:19.900999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f0b82-7bc3-4dd5-bd08-d0df98aa20c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:19.902790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f0b82-7bc3-4dd5-bd08-d0df98aa20c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:19.903665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f0b82-7bc3-4dd5-bd08-d0df98aa20c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:19.906983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f0b82-7bc3-4dd5-bd08-d0df98aa20c3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:19.921674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 350/696] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:19.932214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f0b82-7bc3-4dd5-bd08-d0df98aa20c3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:20.068001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc761b5-bfbb-46e0-85c6-7e997a997443 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:20.157377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a6fb0-5fab-445b-b8ee-0fe0af5d5bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:20.158820 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a6fb0-5fab-445b-b8ee-0fe0af5d5bd5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:20.159309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a6fb0-5fab-445b-b8ee-0fe0af5d5bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:20.159792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a6fb0-5fab-445b-b8ee-0fe0af5d5bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:20.200017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a6fb0-5fab-445b-b8ee-0fe0af5d5bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:20.203111 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a6fb0-5fab-445b-b8ee-0fe0af5d5bd5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:20.246420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-af5a6fb0-5fab-445b-b8ee-0fe0af5d5bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:20.249380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 347/697] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:20.254005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f0b82-7bc3-4dd5-bd08-d0df98aa20c3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:20.259871 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a6fb0-5fab-445b-b8ee-0fe0af5d5bd5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:20.367952 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93b35d-f6ca-4e28-83f8-493c3568eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:20.368690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93b35d-f6ca-4e28-83f8-493c3568eb13 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:20.368972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93b35d-f6ca-4e28-83f8-493c3568eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:20.369293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93b35d-f6ca-4e28-83f8-493c3568eb13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:20.400018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93b35d-f6ca-4e28-83f8-493c3568eb13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:20.402202 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93b35d-f6ca-4e28-83f8-493c3568eb13 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:20.451596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-ce93b35d-f6ca-4e28-83f8-493c3568eb13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:20.454081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 351/698] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 523 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:20.463743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93b35d-f6ca-4e28-83f8-493c3568eb13 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:20.534833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a6fb0-5fab-445b-b8ee-0fe0af5d5bd5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:20.641009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a828e7b-cf0f-421e-ae47-d1cc787ab3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:20.642048 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a828e7b-cf0f-421e-ae47-d1cc787ab3ba None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:20.642536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a828e7b-cf0f-421e-ae47-d1cc787ab3ba None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:20.643005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a828e7b-cf0f-421e-ae47-d1cc787ab3ba None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:20.644372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a828e7b-cf0f-421e-ae47-d1cc787ab3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:20.644895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a828e7b-cf0f-421e-ae47-d1cc787ab3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:20.647446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a828e7b-cf0f-421e-ae47-d1cc787ab3ba None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:20.690753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 348/699] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:20.703473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a828e7b-cf0f-421e-ae47-d1cc787ab3ba None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:20.725507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93b35d-f6ca-4e28-83f8-493c3568eb13 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:20.789657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36a756-3f16-4b36-90ce-7b1c868e3116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:20.791330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36a756-3f16-4b36-90ce-7b1c868e3116 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:20.792146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36a756-3f16-4b36-90ce-7b1c868e3116 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:20.792927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36a756-3f16-4b36-90ce-7b1c868e3116 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:20.794625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36a756-3f16-4b36-90ce-7b1c868e3116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:20.795428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36a756-3f16-4b36-90ce-7b1c868e3116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:20.798524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36a756-3f16-4b36-90ce-7b1c868e3116 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:20.822732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 352/700] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:20.831761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36a756-3f16-4b36-90ce-7b1c868e3116 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:21.005522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a828e7b-cf0f-421e-ae47-d1cc787ab3ba None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:21.020523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36a756-3f16-4b36-90ce-7b1c868e3116 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:21.066020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b1421-d44a-4a3a-8fda-25a1acac8501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:21.067118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b1421-d44a-4a3a-8fda-25a1acac8501 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:21.067584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b1421-d44a-4a3a-8fda-25a1acac8501 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:21.068044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b1421-d44a-4a3a-8fda-25a1acac8501 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:21.069334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b1421-d44a-4a3a-8fda-25a1acac8501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:21.072647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b1421-d44a-4a3a-8fda-25a1acac8501 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:21.080776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc945220-9c99-4c4b-9328-b2ca057adc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:21.082149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945220-9c99-4c4b-9328-b2ca057adc1c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:21.082593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945220-9c99-4c4b-9328-b2ca057adc1c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:21.083025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945220-9c99-4c4b-9328-b2ca057adc1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:21.097442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc945220-9c99-4c4b-9328-b2ca057adc1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:21.100658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc945220-9c99-4c4b-9328-b2ca057adc1c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:21.117909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 349/701] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:40:20 2022] POST /identity/v3/users => generated 254 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:40:21.148839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-bc945220-9c99-4c4b-9328-b2ca057adc1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 22 19:40:21.151625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 353/702] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Mar 22 19:40:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:21.160614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b1421-d44a-4a3a-8fda-25a1acac8501 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:21.309977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3754-f76a-4527-a1d9-f322ed6a5f44 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:21.310776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3754-f76a-4527-a1d9-f322ed6a5f44 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:21.310935 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3754-f76a-4527-a1d9-f322ed6a5f44 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:21.313320 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 354/703] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:40:21.324116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6a8e5-0abc-4651-a6d1-2dcceb29c385 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:21.324649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6a8e5-0abc-4651-a6d1-2dcceb29c385 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:21.325883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6a8e5-0abc-4651-a6d1-2dcceb29c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:21.389124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-dac6a8e5-0abc-4651-a6d1-2dcceb29c385 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:21.394994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-dac6a8e5-0abc-4651-a6d1-2dcceb29c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:21.434238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b1421-d44a-4a3a-8fda-25a1acac8501 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:21.504750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561506f5-2308-48d6-9a32-86fd68d7fc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:21.506264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561506f5-2308-48d6-9a32-86fd68d7fc70 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:21.506939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561506f5-2308-48d6-9a32-86fd68d7fc70 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:21.507623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561506f5-2308-48d6-9a32-86fd68d7fc70 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:21.509303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561506f5-2308-48d6-9a32-86fd68d7fc70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:21.510101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561506f5-2308-48d6-9a32-86fd68d7fc70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:21.512936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561506f5-2308-48d6-9a32-86fd68d7fc70 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:21.546564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 355/704] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:21.547183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 350/705] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Mar 22 19:40:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:21.557226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6a8e5-0abc-4651-a6d1-2dcceb29c385 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:21.590099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561506f5-2308-48d6-9a32-86fd68d7fc70 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:21.751682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6a8e5-0abc-4651-a6d1-2dcceb29c385 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:21.772095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561506f5-2308-48d6-9a32-86fd68d7fc70 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:21.815200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4461e7-56b3-4a28-9d9a-32bc232675c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:21.816431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4461e7-56b3-4a28-9d9a-32bc232675c5 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:21.816885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4461e7-56b3-4a28-9d9a-32bc232675c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:21.817355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4461e7-56b3-4a28-9d9a-32bc232675c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:21.846250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7a5de-24df-4514-8de7-d8f7c3da9cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:21.846250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7a5de-24df-4514-8de7-d8f7c3da9cd5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:21.846250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7a5de-24df-4514-8de7-d8f7c3da9cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:21.846250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7a5de-24df-4514-8de7-d8f7c3da9cd5 None admin] PATH_INFO: `/v3/services/network` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:21.846549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7a5de-24df-4514-8de7-d8f7c3da9cd5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:21.847702 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7a5de-24df-4514-8de7-d8f7c3da9cd5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:21.902228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-7da7a5de-24df-4514-8de7-d8f7c3da9cd5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 22 19:40:21.904698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 351/706] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:21 2022] GET /identity/v3/services/network => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:21.914102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7a5de-24df-4514-8de7-d8f7c3da9cd5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:21.993706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4461e7-56b3-4a28-9d9a-32bc232675c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:21.997012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4461e7-56b3-4a28-9d9a-32bc232675c5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:22.123200 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7a5de-24df-4514-8de7-d8f7c3da9cd5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:22.142246 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 356/707] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:40:22.143778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6689c4-0839-4ec4-8b14-33717df30611 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:22.144114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6689c4-0839-4ec4-8b14-33717df30611 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:22.144728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6689c4-0839-4ec4-8b14-33717df30611 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:22.147127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 357/708] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:22.148076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6689c4-0839-4ec4-8b14-33717df30611 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:22.174884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb5a4d-29db-44fb-8f89-fabb83feef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:22.176546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb5a4d-29db-44fb-8f89-fabb83feef02 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:22.176546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb5a4d-29db-44fb-8f89-fabb83feef02 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:22.176546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb5a4d-29db-44fb-8f89-fabb83feef02 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:22.177264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb5a4d-29db-44fb-8f89-fabb83feef02 None admin] RBAC: Adding query filter params (name=network) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:22.177491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb5a4d-29db-44fb-8f89-fabb83feef02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:22.179024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb5a4d-29db-44fb-8f89-fabb83feef02 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:22.190520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 352/709] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:40:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:22.192014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367b39d-8da4-4ffb-b61f-884e9eca7db5 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:22.192298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367b39d-8da4-4ffb-b61f-884e9eca7db5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:22.192547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367b39d-8da4-4ffb-b61f-884e9eca7db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:22.211711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7367b39d-8da4-4ffb-b61f-884e9eca7db5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:22.212935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7367b39d-8da4-4ffb-b61f-884e9eca7db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:22.287079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 353/710] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:22.287967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367b39d-8da4-4ffb-b61f-884e9eca7db5 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:22.338409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6689c4-0839-4ec4-8b14-33717df30611 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:22.400222 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b2c4-9ab6-4879-89de-02311fa8446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:22.401430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b2c4-9ab6-4879-89de-02311fa8446b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:22.401898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b2c4-9ab6-4879-89de-02311fa8446b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:22.402403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0b2c4-9ab6-4879-89de-02311fa8446b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:22.415277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367b39d-8da4-4ffb-b61f-884e9eca7db5 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:22.421534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0b2c4-9ab6-4879-89de-02311fa8446b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:22.424298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0b2c4-9ab6-4879-89de-02311fa8446b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:22.451747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5510301-2fa9-45b0-af4c-0caeb7861547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:22.452427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510301-2fa9-45b0-af4c-0caeb7861547 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:22.452718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510301-2fa9-45b0-af4c-0caeb7861547 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:22.453053 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510301-2fa9-45b0-af4c-0caeb7861547 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:22.453774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5510301-2fa9-45b0-af4c-0caeb7861547 None admin] RBAC: Adding query filter params (type=network) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:22.454110 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5510301-2fa9-45b0-af4c-0caeb7861547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:22.455516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5510301-2fa9-45b0-af4c-0caeb7861547 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:22.457025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-f5a0b2c4-9ab6-4879-89de-02311fa8446b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:22.459580 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 358/711] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:22.461439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b2c4-9ab6-4879-89de-02311fa8446b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:22.470421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 354/712] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:40:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:22.484675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5510301-2fa9-45b0-af4c-0caeb7861547 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:22.665094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0b2c4-9ab6-4879-89de-02311fa8446b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:22.729087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62366e1-aff5-4637-8dc1-2e8a207e2d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:22.731181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62366e1-aff5-4637-8dc1-2e8a207e2d0c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:22.732034 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62366e1-aff5-4637-8dc1-2e8a207e2d0c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:22.732818 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62366e1-aff5-4637-8dc1-2e8a207e2d0c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:22.734387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62366e1-aff5-4637-8dc1-2e8a207e2d0c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:22.737409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62366e1-aff5-4637-8dc1-2e8a207e2d0c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:22.795544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-f62366e1-aff5-4637-8dc1-2e8a207e2d0c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 22 19:40:22.798160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 359/713] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Mar 22 19:40:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:22.805318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62366e1-aff5-4637-8dc1-2e8a207e2d0c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:22.816841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5510301-2fa9-45b0-af4c-0caeb7861547 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:22.931215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e8f1f-92cb-4386-840b-ea51e2bbfff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:22.932877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e8f1f-92cb-4386-840b-ea51e2bbfff7 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:22.933635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e8f1f-92cb-4386-840b-ea51e2bbfff7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:22.934417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e8f1f-92cb-4386-840b-ea51e2bbfff7 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:22.936040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e8f1f-92cb-4386-840b-ea51e2bbfff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:22.936845 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e8f1f-92cb-4386-840b-ea51e2bbfff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:22.939761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e8f1f-92cb-4386-840b-ea51e2bbfff7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:22.979977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 355/714] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:22.986456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e8f1f-92cb-4386-840b-ea51e2bbfff7 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:23.113991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62366e1-aff5-4637-8dc1-2e8a207e2d0c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:23.220783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae4128-49d7-402f-abf3-ba4eaad90fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:23.221913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae4128-49d7-402f-abf3-ba4eaad90fd1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:23.222441 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae4128-49d7-402f-abf3-ba4eaad90fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:23.222935 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae4128-49d7-402f-abf3-ba4eaad90fd1 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:23.224699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae4128-49d7-402f-abf3-ba4eaad90fd1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:23.225266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae4128-49d7-402f-abf3-ba4eaad90fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:23.228031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae4128-49d7-402f-abf3-ba4eaad90fd1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:23.253983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 360/715] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Mar 22 19:40:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:23.263758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae4128-49d7-402f-abf3-ba4eaad90fd1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:23.290536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e8f1f-92cb-4386-840b-ea51e2bbfff7 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:23.327598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d129f5-30d5-4977-a617-c7300d153187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:23.328636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d129f5-30d5-4977-a617-c7300d153187 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:23.328924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d129f5-30d5-4977-a617-c7300d153187 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:23.329199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d129f5-30d5-4977-a617-c7300d153187 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:23.337380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d129f5-30d5-4977-a617-c7300d153187 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:23.338908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d129f5-30d5-4977-a617-c7300d153187 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:23.353724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-16d129f5-30d5-4977-a617-c7300d153187 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:23.355424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 356/716] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:23.356748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25fd00-fe8c-4910-a0f5-f88a7aea34d6 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:23.357037 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25fd00-fe8c-4910-a0f5-f88a7aea34d6 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:23.357311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25fd00-fe8c-4910-a0f5-f88a7aea34d6 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:23.364370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 357/717] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:23.365236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25fd00-fe8c-4910-a0f5-f88a7aea34d6 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:23.440262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae4128-49d7-402f-abf3-ba4eaad90fd1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:23.474364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25fd00-fe8c-4910-a0f5-f88a7aea34d6 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:23.501630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320571-7046-45a6-a036-d2661e2e0d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:23.502778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320571-7046-45a6-a036-d2661e2e0d87 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:23.503082 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320571-7046-45a6-a036-d2661e2e0d87 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:23.503312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320571-7046-45a6-a036-d2661e2e0d87 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:23.504338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320571-7046-45a6-a036-d2661e2e0d87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:23.504642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320571-7046-45a6-a036-d2661e2e0d87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:23.506293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320571-7046-45a6-a036-d2661e2e0d87 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:23.516954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 361/718] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Mar 22 19:40:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:23.519554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243b98-3067-4d45-845e-a0dcdf6f290e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:23.525992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243b98-3067-4d45-845e-a0dcdf6f290e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:23.525992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243b98-3067-4d45-845e-a0dcdf6f290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:23.531117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5f3ac-2fe4-4c4d-941b-b4e737a6e29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:23.532299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f3ac-2fe4-4c4d-941b-b4e737a6e29d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:23.532804 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f3ac-2fe4-4c4d-941b-b4e737a6e29d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:23.534455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f3ac-2fe4-4c4d-941b-b4e737a6e29d None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:23.536085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5f3ac-2fe4-4c4d-941b-b4e737a6e29d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:23.536637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5f3ac-2fe4-4c4d-941b-b4e737a6e29d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:23.546696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5f3ac-2fe4-4c4d-941b-b4e737a6e29d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:23.583392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-77243b98-3067-4d45-845e-a0dcdf6f290e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:23.589862 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 358/719] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:23.590418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-77243b98-3067-4d45-845e-a0dcdf6f290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:23.599323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5f3ac-2fe4-4c4d-941b-b4e737a6e29d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:23.737127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5f3ac-2fe4-4c4d-941b-b4e737a6e29d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:23.777984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416c792-6ea9-42c3-b96e-9b1c9bb547e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:23.778682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416c792-6ea9-42c3-b96e-9b1c9bb547e0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:23.778971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416c792-6ea9-42c3-b96e-9b1c9bb547e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:23.779306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416c792-6ea9-42c3-b96e-9b1c9bb547e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:23.780222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416c792-6ea9-42c3-b96e-9b1c9bb547e0 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=7f74d49fc68344899f70efb85eb1c97d) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:23.780557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416c792-6ea9-42c3-b96e-9b1c9bb547e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:23.782134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416c792-6ea9-42c3-b96e-9b1c9bb547e0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:23.794221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 359/720] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:23 2022] GET /identity/v3/role_assignments?user.id=7f74d49fc68344899f70efb85eb1c97d&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:23.859507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 362/721] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:23.904858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416c792-6ea9-42c3-b96e-9b1c9bb547e0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:24.093599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416c792-6ea9-42c3-b96e-9b1c9bb547e0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:24.135717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d711eb1-3b53-427b-a270-15cdd36ec046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:24.136562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711eb1-3b53-427b-a270-15cdd36ec046 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:24.136836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711eb1-3b53-427b-a270-15cdd36ec046 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:24.137108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711eb1-3b53-427b-a270-15cdd36ec046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:24.149811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d711eb1-3b53-427b-a270-15cdd36ec046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:24.156933 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-8d711eb1-3b53-427b-a270-15cdd36ec046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:40:24.158581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 360/722] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:24.165438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243b98-3067-4d45-845e-a0dcdf6f290e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:24.318352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243b98-3067-4d45-845e-a0dcdf6f290e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:24.368690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2745-1d80-4f1a-b9ff-8fbccd434ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:24.369927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2745-1d80-4f1a-b9ff-8fbccd434ccf None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:24.370252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2745-1d80-4f1a-b9ff-8fbccd434ccf None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:24.370528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2745-1d80-4f1a-b9ff-8fbccd434ccf None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:24.371300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c2745-1d80-4f1a-b9ff-8fbccd434ccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:24.371613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c2745-1d80-4f1a-b9ff-8fbccd434ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:24.373023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c2745-1d80-4f1a-b9ff-8fbccd434ccf None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:24.387064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 363/723] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:24.392641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d711eb1-3b53-427b-a270-15cdd36ec046 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:24.549354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d711eb1-3b53-427b-a270-15cdd36ec046 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:24.585333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cb42d-9fae-41b3-90c9-a90673b38f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:24.586630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cb42d-9fae-41b3-90c9-a90673b38f7d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:24.587130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cb42d-9fae-41b3-90c9-a90673b38f7d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:24.587599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cb42d-9fae-41b3-90c9-a90673b38f7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:24.600392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cb42d-9fae-41b3-90c9-a90673b38f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:24.602402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cb42d-9fae-41b3-90c9-a90673b38f7d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:24.621007 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-4b1cb42d-9fae-41b3-90c9-a90673b38f7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:24.622983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 361/724] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:24.631143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2745-1d80-4f1a-b9ff-8fbccd434ccf None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:24.782215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2745-1d80-4f1a-b9ff-8fbccd434ccf None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:24.827176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc98524-5fef-4b4a-83c6-0e67b74e6455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:24.828247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc98524-5fef-4b4a-83c6-0e67b74e6455 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:24.828745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc98524-5fef-4b4a-83c6-0e67b74e6455 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:24.840110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc98524-5fef-4b4a-83c6-0e67b74e6455 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:24.841242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc98524-5fef-4b4a-83c6-0e67b74e6455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:24.841772 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc98524-5fef-4b4a-83c6-0e67b74e6455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:24.847539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc98524-5fef-4b4a-83c6-0e67b74e6455 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:24.866289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 364/725] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:24.873024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cb42d-9fae-41b3-90c9-a90673b38f7d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:25.153806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cb42d-9fae-41b3-90c9-a90673b38f7d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:25.233042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711380b-268b-4f0e-80da-2ae8b16376b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:25.234310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711380b-268b-4f0e-80da-2ae8b16376b6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:25.234791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711380b-268b-4f0e-80da-2ae8b16376b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:25.235265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711380b-268b-4f0e-80da-2ae8b16376b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:25.250450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711380b-268b-4f0e-80da-2ae8b16376b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:25.252267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711380b-268b-4f0e-80da-2ae8b16376b6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:25.269200 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-1711380b-268b-4f0e-80da-2ae8b16376b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 22 19:40:25.271232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 362/726] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:25.277532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc98524-5fef-4b4a-83c6-0e67b74e6455 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:25.492952 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc98524-5fef-4b4a-83c6-0e67b74e6455 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:25.542384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56676-67e9-4267-b3d1-9387363205d7 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:25.543043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56676-67e9-4267-b3d1-9387363205d7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:25.543543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56676-67e9-4267-b3d1-9387363205d7 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:25.546031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 363/727] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:25.552301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7a85-5d7a-401b-a6c6-f2e029cec245 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:25.552935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7a85-5d7a-401b-a6c6-f2e029cec245 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:25.553411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7a85-5d7a-401b-a6c6-f2e029cec245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:25.571606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bf26a-f641-431c-89b9-3631431e589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:25.572731 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bf26a-f641-431c-89b9-3631431e589d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:25.573196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bf26a-f641-431c-89b9-3631431e589d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:25.573653 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bf26a-f641-431c-89b9-3631431e589d None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:25.575186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bf26a-f641-431c-89b9-3631431e589d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:25.575696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bf26a-f641-431c-89b9-3631431e589d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:25.578278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bf26a-f641-431c-89b9-3631431e589d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:25.609330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-b1de7a85-5d7a-401b-a6c6-f2e029cec245 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:25.611515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b1de7a85-5d7a-401b-a6c6-f2e029cec245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:25.637158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 365/728] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Mar 22 19:40:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:25.647937 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bf26a-f641-431c-89b9-3631431e589d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:25.742735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 364/729] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:25.770709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7a85-5d7a-401b-a6c6-f2e029cec245 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:25.849451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bf26a-f641-431c-89b9-3631431e589d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:25.921509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd850c8-96fc-4da3-b926-4d0b4bd70e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:25.922621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd850c8-96fc-4da3-b926-4d0b4bd70e34 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:25.923102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd850c8-96fc-4da3-b926-4d0b4bd70e34 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:25.923585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd850c8-96fc-4da3-b926-4d0b4bd70e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:26.057019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd850c8-96fc-4da3-b926-4d0b4bd70e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:26.060548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd850c8-96fc-4da3-b926-4d0b4bd70e34 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:26.075713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7a85-5d7a-401b-a6c6-f2e029cec245 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:26.115664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d197a-9b83-44b7-a62b-155cacf2c465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:26.116651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d197a-9b83-44b7-a62b-155cacf2c465 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:26.116879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d197a-9b83-44b7-a62b-155cacf2c465 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:26.117120 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d197a-9b83-44b7-a62b-155cacf2c465 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:26.131020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d197a-9b83-44b7-a62b-155cacf2c465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:26.138403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-cb7d197a-9b83-44b7-a62b-155cacf2c465 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:26.139997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 365/730] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:26.141432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c861de4-274d-4ecc-acd4-ead08acc736d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:26.141739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c861de4-274d-4ecc-acd4-ead08acc736d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:26.142076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c861de4-274d-4ecc-acd4-ead08acc736d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:26.144134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 366/731] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:26.145218 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c861de4-274d-4ecc-acd4-ead08acc736d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:26.248753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 366/732] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:40:26.251538 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8ebdd-f7b5-4e1b-9cf0-3784a1e6ea79 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:26.252325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8ebdd-f7b5-4e1b-9cf0-3784a1e6ea79 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:26.253087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8ebdd-f7b5-4e1b-9cf0-3784a1e6ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:26.261248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c861de4-274d-4ecc-acd4-ead08acc736d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:26.283096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-f5d8ebdd-f7b5-4e1b-9cf0-3784a1e6ea79 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:26.285517 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f5d8ebdd-f7b5-4e1b-9cf0-3784a1e6ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:26.297815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff949c0c-9a2a-4563-9fce-86bfa54a5efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:26.298597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949c0c-9a2a-4563-9fce-86bfa54a5efc None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:26.298878 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949c0c-9a2a-4563-9fce-86bfa54a5efc None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:26.299183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949c0c-9a2a-4563-9fce-86bfa54a5efc None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:26.299910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff949c0c-9a2a-4563-9fce-86bfa54a5efc None admin] RBAC: Adding query filter params (name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:26.300217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff949c0c-9a2a-4563-9fce-86bfa54a5efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:26.301716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff949c0c-9a2a-4563-9fce-86bfa54a5efc None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:26.310824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 367/733] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:26.311754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff949c0c-9a2a-4563-9fce-86bfa54a5efc None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:26.407510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 367/734] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:26.409471 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8ebdd-f7b5-4e1b-9cf0-3784a1e6ea79 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:26.420597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff949c0c-9a2a-4563-9fce-86bfa54a5efc None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:26.456101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b032bb4-a0c2-4f18-a642-db3d22653df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:26.456376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b032bb4-a0c2-4f18-a642-db3d22653df5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:26.456734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b032bb4-a0c2-4f18-a642-db3d22653df5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:26.456953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b032bb4-a0c2-4f18-a642-db3d22653df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:26.469553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b032bb4-a0c2-4f18-a642-db3d22653df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:26.471083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b032bb4-a0c2-4f18-a642-db3d22653df5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:26.489108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-3b032bb4-a0c2-4f18-a642-db3d22653df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:26.490697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 368/735] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:26.491587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b032bb4-a0c2-4f18-a642-db3d22653df5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:26.604936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b032bb4-a0c2-4f18-a642-db3d22653df5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:26.607743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8ebdd-f7b5-4e1b-9cf0-3784a1e6ea79 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:26.640086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e427-7a34-4a7c-a0db-b88cf8e46967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:26.641062 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e427-7a34-4a7c-a0db-b88cf8e46967 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:26.641489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e427-7a34-4a7c-a0db-b88cf8e46967 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:26.641920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e427-7a34-4a7c-a0db-b88cf8e46967 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:26.642841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e427-7a34-4a7c-a0db-b88cf8e46967 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:26.644386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e427-7a34-4a7c-a0db-b88cf8e46967 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:26.664137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 369/736] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:40:26 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:40:26.665298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e427-7a34-4a7c-a0db-b88cf8e46967 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:26.720001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131d412-4574-44e9-a354-cf8d56ddd251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:26.721735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d412-4574-44e9-a354-cf8d56ddd251 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:26.722176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d412-4574-44e9-a354-cf8d56ddd251 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:26.722790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d412-4574-44e9-a354-cf8d56ddd251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:26.765994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131d412-4574-44e9-a354-cf8d56ddd251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:26.768672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131d412-4574-44e9-a354-cf8d56ddd251 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:26.788076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e427-7a34-4a7c-a0db-b88cf8e46967 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:26.827058 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-4131d412-4574-44e9-a354-cf8d56ddd251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:26.827737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e55cc-7411-4c2c-83c2-a50c95521d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:26.828433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e55cc-7411-4c2c-83c2-a50c95521d6b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:26.828716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e55cc-7411-4c2c-83c2-a50c95521d6b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:26.828989 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e55cc-7411-4c2c-83c2-a50c95521d6b None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:26.837247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 368/737] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:26.837542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e55cc-7411-4c2c-83c2-a50c95521d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:26.837542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e55cc-7411-4c2c-83c2-a50c95521d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:26.837542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e55cc-7411-4c2c-83c2-a50c95521d6b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:26.839682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131d412-4574-44e9-a354-cf8d56ddd251 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:26.846310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 370/738] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:26.858087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e55cc-7411-4c2c-83c2-a50c95521d6b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:26.979213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e55cc-7411-4c2c-83c2-a50c95521d6b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:27.024857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065d2c0-0380-4b48-8c74-0f200238cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:27.026658 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d2c0-0380-4b48-8c74-0f200238cfbd None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.027461 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d2c0-0380-4b48-8c74-0f200238cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.028153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d2c0-0380-4b48-8c74-0f200238cfbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.042567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065d2c0-0380-4b48-8c74-0f200238cfbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:27.045877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065d2c0-0380-4b48-8c74-0f200238cfbd None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:27.067778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131d412-4574-44e9-a354-cf8d56ddd251 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:27.073146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-c065d2c0-0380-4b48-8c74-0f200238cfbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:27.078117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 371/739] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:27.078297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2bcdc-a368-43e7-8f3b-6887749a45f1 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.078723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2bcdc-a368-43e7-8f3b-6887749a45f1 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.079210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2bcdc-a368-43e7-8f3b-6887749a45f1 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.082727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 372/740] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:27.087361 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2bcdc-a368-43e7-8f3b-6887749a45f1 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:27.120784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf67b6c-8aa6-479a-bf03-333fbbf1446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:27.120784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67b6c-8aa6-479a-bf03-333fbbf1446c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.121058 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67b6c-8aa6-479a-bf03-333fbbf1446c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.121314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf67b6c-8aa6-479a-bf03-333fbbf1446c None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.121904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf67b6c-8aa6-479a-bf03-333fbbf1446c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:27.122247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf67b6c-8aa6-479a-bf03-333fbbf1446c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:27.123665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf67b6c-8aa6-479a-bf03-333fbbf1446c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:27.140042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 369/741] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:27.142226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd714d3-c44f-4395-b0cd-060d29ed1186 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.142772 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd714d3-c44f-4395-b0cd-060d29ed1186 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.143254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd714d3-c44f-4395-b0cd-060d29ed1186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.170111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-abd714d3-c44f-4395-b0cd-060d29ed1186 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:27.172065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-abd714d3-c44f-4395-b0cd-060d29ed1186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:27.237406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2bcdc-a368-43e7-8f3b-6887749a45f1 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:27.277391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 370/742] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:27 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 22 19:40:27.283229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd714d3-c44f-4395-b0cd-060d29ed1186 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:27.321146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6701d2-9be0-4081-94d8-22a51a4a80f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:27.322447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6701d2-9be0-4081-94d8-22a51a4a80f8 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.322960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6701d2-9be0-4081-94d8-22a51a4a80f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.323466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6701d2-9be0-4081-94d8-22a51a4a80f8 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.326313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6701d2-9be0-4081-94d8-22a51a4a80f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:27.326918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6701d2-9be0-4081-94d8-22a51a4a80f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:27.331191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6701d2-9be0-4081-94d8-22a51a4a80f8 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:27.358089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 373/743] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:27.360238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6701d2-9be0-4081-94d8-22a51a4a80f8 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:27.456726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd714d3-c44f-4395-b0cd-060d29ed1186 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:27.500438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971d788-160d-40df-bd3c-d1b9c0630c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:27.501685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971d788-160d-40df-bd3c-d1b9c0630c31 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.502244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971d788-160d-40df-bd3c-d1b9c0630c31 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.502752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971d788-160d-40df-bd3c-d1b9c0630c31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.511505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971d788-160d-40df-bd3c-d1b9c0630c31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:27.513315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971d788-160d-40df-bd3c-d1b9c0630c31 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:27.536673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6701d2-9be0-4081-94d8-22a51a4a80f8 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:27.543231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-1971d788-160d-40df-bd3c-d1b9c0630c31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 22 19:40:27.545282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 371/744] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:40:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:27.546617 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971d788-160d-40df-bd3c-d1b9c0630c31 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:27.577095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c89a9-65e7-4c51-b974-bdc78eb25df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:27.577909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c89a9-65e7-4c51-b974-bdc78eb25df1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.578230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c89a9-65e7-4c51-b974-bdc78eb25df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.578505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c89a9-65e7-4c51-b974-bdc78eb25df1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.589962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c89a9-65e7-4c51-b974-bdc78eb25df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:27.596951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-0d8c89a9-65e7-4c51-b974-bdc78eb25df1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:40:27.598898 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 374/745] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:27.599701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c89a9-65e7-4c51-b974-bdc78eb25df1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:27.701357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c89a9-65e7-4c51-b974-bdc78eb25df1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:27.717023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971d788-160d-40df-bd3c-d1b9c0630c31 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:27.736228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631c5e2-8dc3-4a59-93a5-2bdd3c0981b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:27.736915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631c5e2-8dc3-4a59-93a5-2bdd3c0981b8 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.737198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631c5e2-8dc3-4a59-93a5-2bdd3c0981b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.737473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631c5e2-8dc3-4a59-93a5-2bdd3c0981b8 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.738364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631c5e2-8dc3-4a59-93a5-2bdd3c0981b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:27.738737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631c5e2-8dc3-4a59-93a5-2bdd3c0981b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:27.740226 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631c5e2-8dc3-4a59-93a5-2bdd3c0981b8 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:27.756746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3c5fe-dc26-42df-9677-c9dbebc7dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:27.758185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c5fe-dc26-42df-9677-c9dbebc7dc49 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.758482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c5fe-dc26-42df-9677-c9dbebc7dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.758763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c5fe-dc26-42df-9677-c9dbebc7dc49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.759597 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3c5fe-dc26-42df-9677-c9dbebc7dc49 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=439b41be395d4faeae0b855a1e0f25f1) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:27.759904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3c5fe-dc26-42df-9677-c9dbebc7dc49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:27.761356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3c5fe-dc26-42df-9677-c9dbebc7dc49 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:27.763861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 375/746] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Mar 22 19:40:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:27.764815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631c5e2-8dc3-4a59-93a5-2bdd3c0981b8 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:27.774085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 372/747] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:27 2022] GET /identity/v3/role_assignments?user.id=439b41be395d4faeae0b855a1e0f25f1&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:27.775123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3c5fe-dc26-42df-9677-c9dbebc7dc49 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:27.885902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631c5e2-8dc3-4a59-93a5-2bdd3c0981b8 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:27.919693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3c5fe-dc26-42df-9677-c9dbebc7dc49 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:27.923176 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb54d8-ecfb-4098-bda8-907eaf784125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:27.923704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb54d8-ecfb-4098-bda8-907eaf784125 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.923986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb54d8-ecfb-4098-bda8-907eaf784125 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.924260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb54d8-ecfb-4098-bda8-907eaf784125 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.925017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb54d8-ecfb-4098-bda8-907eaf784125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:27.925326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb54d8-ecfb-4098-bda8-907eaf784125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:27.926894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb54d8-ecfb-4098-bda8-907eaf784125 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:27.936822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 376/748] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:27.938279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e477-87a3-4201-8e9a-071fe38c9ca4 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.938540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e477-87a3-4201-8e9a-071fe38c9ca4 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.938826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e477-87a3-4201-8e9a-071fe38c9ca4 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.940992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 377/749] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:27.952668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e1e6-81d2-4662-a9cb-ec371cbf31b5 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.953094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e1e6-81d2-4662-a9cb-ec371cbf31b5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.953470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3e1e6-81d2-4662-a9cb-ec371cbf31b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.968125 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979fd7-fe19-4917-a1c8-29d18b49ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:27.969321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979fd7-fe19-4917-a1c8-29d18b49ac79 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:27.969745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979fd7-fe19-4917-a1c8-29d18b49ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:27.970186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979fd7-fe19-4917-a1c8-29d18b49ac79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:27.973716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-f4c3e1e6-81d2-4662-a9cb-ec371cbf31b5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:27.975560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f4c3e1e6-81d2-4662-a9cb-ec371cbf31b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:28.063352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 378/750] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:27 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 22 19:40:28.063699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21979fd7-fe19-4917-a1c8-29d18b49ac79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:28.064484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e1e6-81d2-4662-a9cb-ec371cbf31b5 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:28.065541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21979fd7-fe19-4917-a1c8-29d18b49ac79 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:28.190041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 373/751] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:27 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 22 19:40:28.191264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979fd7-fe19-4917-a1c8-29d18b49ac79 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:28.199208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3e1e6-81d2-4662-a9cb-ec371cbf31b5 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:28.247676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a690e08-1654-4a98-a7aa-cd96982d44d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:28.248583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a690e08-1654-4a98-a7aa-cd96982d44d8 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:28.248961 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a690e08-1654-4a98-a7aa-cd96982d44d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:28.249334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a690e08-1654-4a98-a7aa-cd96982d44d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:28.266114 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a690e08-1654-4a98-a7aa-cd96982d44d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:28.268019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a690e08-1654-4a98-a7aa-cd96982d44d8 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:28.291124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-6a690e08-1654-4a98-a7aa-cd96982d44d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:28.293584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 379/752] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:28.294979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a690e08-1654-4a98-a7aa-cd96982d44d8 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:28.302869 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979fd7-fe19-4917-a1c8-29d18b49ac79 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:28.349824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b01f77-d684-49e0-8139-720deb5a850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:28.351275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b01f77-d684-49e0-8139-720deb5a850f None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:28.351703 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b01f77-d684-49e0-8139-720deb5a850f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:28.352123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b01f77-d684-49e0-8139-720deb5a850f None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:28.353355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b01f77-d684-49e0-8139-720deb5a850f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:28.355434 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b01f77-d684-49e0-8139-720deb5a850f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:28.374619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 374/753] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:40:28 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:40:28.375864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b01f77-d684-49e0-8139-720deb5a850f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:28.490623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a690e08-1654-4a98-a7aa-cd96982d44d8 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:28.600576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b01f77-d684-49e0-8139-720deb5a850f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:28.604270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b15685-64e8-4290-a1f9-b061182e726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:28.605098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b15685-64e8-4290-a1f9-b061182e726d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:28.605385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b15685-64e8-4290-a1f9-b061182e726d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:28.605664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b15685-64e8-4290-a1f9-b061182e726d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:28.616974 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b15685-64e8-4290-a1f9-b061182e726d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:28.618768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b15685-64e8-4290-a1f9-b061182e726d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:28.639412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-20b15685-64e8-4290-a1f9-b061182e726d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:28.641142 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 380/754] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:28.646741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b15685-64e8-4290-a1f9-b061182e726d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:28.664584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c2f3-adee-4d4e-892f-cc45174e49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:28.665696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c2f3-adee-4d4e-892f-cc45174e49d9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:28.666258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c2f3-adee-4d4e-892f-cc45174e49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:28.666717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c2f3-adee-4d4e-892f-cc45174e49d9 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:28.668009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c2f3-adee-4d4e-892f-cc45174e49d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:28.668537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c2f3-adee-4d4e-892f-cc45174e49d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:28.671147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c2f3-adee-4d4e-892f-cc45174e49d9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:28.693779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 375/755] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:28.701018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c2f3-adee-4d4e-892f-cc45174e49d9 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:28.752649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b15685-64e8-4290-a1f9-b061182e726d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:28.789389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28d877-cc37-4195-b2c2-4c8bb479ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:28.790115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28d877-cc37-4195-b2c2-4c8bb479ac7b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:28.790401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28d877-cc37-4195-b2c2-4c8bb479ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:28.790685 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28d877-cc37-4195-b2c2-4c8bb479ac7b None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:28.791582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28d877-cc37-4195-b2c2-4c8bb479ac7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:28.791902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28d877-cc37-4195-b2c2-4c8bb479ac7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:28.793351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28d877-cc37-4195-b2c2-4c8bb479ac7b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:28.807155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 381/756] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:28.812817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28d877-cc37-4195-b2c2-4c8bb479ac7b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:28.884133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c2f3-adee-4d4e-892f-cc45174e49d9 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:28.922594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28d877-cc37-4195-b2c2-4c8bb479ac7b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:28.947053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d779082-cec6-4b0c-a84f-8b411babeceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:28.948449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d779082-cec6-4b0c-a84f-8b411babeceb None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:28.948943 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d779082-cec6-4b0c-a84f-8b411babeceb None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:28.949431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d779082-cec6-4b0c-a84f-8b411babeceb None admin] PATH_INFO: `/v3/users/nova` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:28.960079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a13101-e284-45da-b0a8-378921a2cb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:28.961358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a13101-e284-45da-b0a8-378921a2cb67 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:28.961644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a13101-e284-45da-b0a8-378921a2cb67 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:28.961918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a13101-e284-45da-b0a8-378921a2cb67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:28.963783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d779082-cec6-4b0c-a84f-8b411babeceb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:28.966594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d779082-cec6-4b0c-a84f-8b411babeceb None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:28.969659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a13101-e284-45da-b0a8-378921a2cb67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:28.971179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a13101-e284-45da-b0a8-378921a2cb67 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:28.985313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-e2a13101-e284-45da-b0a8-378921a2cb67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:28.987008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 382/757] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:28.992768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a13101-e284-45da-b0a8-378921a2cb67 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:28.993768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-4d779082-cec6-4b0c-a84f-8b411babeceb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 22 19:40:28.996464 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 376/758] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Mar 22 19:40:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:29.005229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d779082-cec6-4b0c-a84f-8b411babeceb None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:29.205712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d779082-cec6-4b0c-a84f-8b411babeceb None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:29.280885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d281fe-b33a-4e2f-bc2f-e5b07bf1e499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:29.282097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d281fe-b33a-4e2f-bc2f-e5b07bf1e499 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:29.282591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d281fe-b33a-4e2f-bc2f-e5b07bf1e499 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:29.283161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d281fe-b33a-4e2f-bc2f-e5b07bf1e499 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:29.284826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d281fe-b33a-4e2f-bc2f-e5b07bf1e499 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:29.285394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d281fe-b33a-4e2f-bc2f-e5b07bf1e499 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:29.288128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d281fe-b33a-4e2f-bc2f-e5b07bf1e499 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:29.323826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 377/759] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Mar 22 19:40:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:29.334564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d281fe-b33a-4e2f-bc2f-e5b07bf1e499 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:29.349338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a13101-e284-45da-b0a8-378921a2cb67 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:29.456035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c5311-12ad-46da-96ad-ed46fa9c7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:29.456743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c5311-12ad-46da-96ad-ed46fa9c7308 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:29.457022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c5311-12ad-46da-96ad-ed46fa9c7308 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:29.457447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c5311-12ad-46da-96ad-ed46fa9c7308 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:29.458399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c5311-12ad-46da-96ad-ed46fa9c7308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:29.458791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c5311-12ad-46da-96ad-ed46fa9c7308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:29.460741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c5311-12ad-46da-96ad-ed46fa9c7308 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:29.494557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 383/760] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:29.516232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be4e2a-36d7-473b-a573-0cbcd99b67d5 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:29.516549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be4e2a-36d7-473b-a573-0cbcd99b67d5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:29.516788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be4e2a-36d7-473b-a573-0cbcd99b67d5 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:29.519173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 384/761] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:40:29.520040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be4e2a-36d7-473b-a573-0cbcd99b67d5 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:29.529876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d281fe-b33a-4e2f-bc2f-e5b07bf1e499 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:29.573483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae8509-6b56-43c4-93e4-6d16fa62f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:29.574853 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8509-6b56-43c4-93e4-6d16fa62f080 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:29.576267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8509-6b56-43c4-93e4-6d16fa62f080 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:29.576543 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8509-6b56-43c4-93e4-6d16fa62f080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:29.593985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae8509-6b56-43c4-93e4-6d16fa62f080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:29.596742 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae8509-6b56-43c4-93e4-6d16fa62f080 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:29.621834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-c2ae8509-6b56-43c4-93e4-6d16fa62f080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:29.624304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 378/762] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:29.625747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c84cb-a759-4974-af52-5739ce6a097a None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:29.626405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c84cb-a759-4974-af52-5739ce6a097a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:29.626915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c84cb-a759-4974-af52-5739ce6a097a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:29.648196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9d2c84cb-a759-4974-af52-5739ce6a097a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:29.649824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9d2c84cb-a759-4974-af52-5739ce6a097a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:29.662396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be4e2a-36d7-473b-a573-0cbcd99b67d5 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:29.716024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2efb2-91a5-4a7d-986e-5a24e52660fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:29.717492 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2efb2-91a5-4a7d-986e-5a24e52660fe None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:29.717923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2efb2-91a5-4a7d-986e-5a24e52660fe None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:29.718386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2efb2-91a5-4a7d-986e-5a24e52660fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:29.719544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2efb2-91a5-4a7d-986e-5a24e52660fe None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=d526f13b514045ec9ebee14edf3fe79f) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:29.720333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2efb2-91a5-4a7d-986e-5a24e52660fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:29.722264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2efb2-91a5-4a7d-986e-5a24e52660fe None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:29.730059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 385/763] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:29 2022] GET /identity/v3/role_assignments?user.id=d526f13b514045ec9ebee14edf3fe79f&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:29.731228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2efb2-91a5-4a7d-986e-5a24e52660fe None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:29.734611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 379/764] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:29.753464 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c84cb-a759-4974-af52-5739ce6a097a None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:29.877677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2efb2-91a5-4a7d-986e-5a24e52660fe None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:29.921368 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc45a2-7e4a-40a1-8c53-c9a3adfebc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:29.922182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc45a2-7e4a-40a1-8c53-c9a3adfebc57 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:29.922610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc45a2-7e4a-40a1-8c53-c9a3adfebc57 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:29.922890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc45a2-7e4a-40a1-8c53-c9a3adfebc57 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:29.923661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc45a2-7e4a-40a1-8c53-c9a3adfebc57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:29.923974 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc45a2-7e4a-40a1-8c53-c9a3adfebc57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:29.925460 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc45a2-7e4a-40a1-8c53-c9a3adfebc57 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:29.941997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 386/765] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:29.953924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc45a2-7e4a-40a1-8c53-c9a3adfebc57 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:29.983284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c84cb-a759-4974-af52-5739ce6a097a None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:30.062164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ce36-873b-4e29-9cb5-ec168d941b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:30.063045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ce36-873b-4e29-9cb5-ec168d941b65 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:30.063328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ce36-873b-4e29-9cb5-ec168d941b65 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:30.063604 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ce36-873b-4e29-9cb5-ec168d941b65 None admin] PATH_INFO: `/v3/services/network` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:30.064283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948ce36-873b-4e29-9cb5-ec168d941b65 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:30.065747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948ce36-873b-4e29-9cb5-ec168d941b65 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:30.086553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a948ce36-873b-4e29-9cb5-ec168d941b65 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 22 19:40:30.088187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 380/766] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:29 2022] GET /identity/v3/services/network => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:30.094012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ce36-873b-4e29-9cb5-ec168d941b65 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:30.194370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc45a2-7e4a-40a1-8c53-c9a3adfebc57 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:30.271859 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c911e88-6602-4452-a120-917d345cdad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:30.272653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c911e88-6602-4452-a120-917d345cdad5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:30.273064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c911e88-6602-4452-a120-917d345cdad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:30.273353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c911e88-6602-4452-a120-917d345cdad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:30.290101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ce36-873b-4e29-9cb5-ec168d941b65 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:30.291356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c911e88-6602-4452-a120-917d345cdad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:30.292865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c911e88-6602-4452-a120-917d345cdad5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:30.321316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-4c911e88-6602-4452-a120-917d345cdad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:30.324486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 387/767] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:30.332008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c911e88-6602-4452-a120-917d345cdad5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:30.372135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be340625-070a-4649-ac3f-badf665096af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:30.372830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340625-070a-4649-ac3f-badf665096af None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:30.373138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340625-070a-4649-ac3f-badf665096af None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:30.373413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340625-070a-4649-ac3f-badf665096af None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:30.374190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be340625-070a-4649-ac3f-badf665096af None admin] RBAC: Adding query filter params (name=network) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:30.374501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be340625-070a-4649-ac3f-badf665096af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:30.375927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be340625-070a-4649-ac3f-badf665096af None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:30.388728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 381/768] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:40:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:30.394482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be340625-070a-4649-ac3f-badf665096af None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:30.454678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c911e88-6602-4452-a120-917d345cdad5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:30.499599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39204d-3843-4731-92c0-d1df6f074c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:30.500325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39204d-3843-4731-92c0-d1df6f074c19 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:30.500664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39204d-3843-4731-92c0-d1df6f074c19 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:30.500906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39204d-3843-4731-92c0-d1df6f074c19 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:30.501659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39204d-3843-4731-92c0-d1df6f074c19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:30.501999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39204d-3843-4731-92c0-d1df6f074c19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:30.503515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39204d-3843-4731-92c0-d1df6f074c19 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:30.530762 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 388/769] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:30.536837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39204d-3843-4731-92c0-d1df6f074c19 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:30.624570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be340625-070a-4649-ac3f-badf665096af None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:30.697922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f54e8-b3a4-4e54-8533-a14ddf4880e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:30.699596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f54e8-b3a4-4e54-8533-a14ddf4880e9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:30.700101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f54e8-b3a4-4e54-8533-a14ddf4880e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:30.700529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f54e8-b3a4-4e54-8533-a14ddf4880e9 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:30.701849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f54e8-b3a4-4e54-8533-a14ddf4880e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:30.702271 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f54e8-b3a4-4e54-8533-a14ddf4880e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:30.704854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f54e8-b3a4-4e54-8533-a14ddf4880e9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:30.708825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39204d-3843-4731-92c0-d1df6f074c19 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:30.725970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 382/770] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:40:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:30.730094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f54e8-b3a4-4e54-8533-a14ddf4880e9 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:30.775737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095da0b-cbde-4c5e-953e-e20e69194486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:30.776651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095da0b-cbde-4c5e-953e-e20e69194486 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:30.776920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095da0b-cbde-4c5e-953e-e20e69194486 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:30.777193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095da0b-cbde-4c5e-953e-e20e69194486 None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/7f74d49fc68344899f70efb85eb1c97d/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:30.780505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095da0b-cbde-4c5e-953e-e20e69194486 None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=7f74d49fc68344899f70efb85eb1c97d, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:30.782099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095da0b-cbde-4c5e-953e-e20e69194486 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:30.815141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 389/771] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:40:30 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/7f74d49fc68344899f70efb85eb1c97d/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:40:30.865130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f54e8-b3a4-4e54-8533-a14ddf4880e9 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:30.903614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dcb4c-a16e-4696-ab7e-488c7dda49e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:30.904725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dcb4c-a16e-4696-ab7e-488c7dda49e5 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:30.905267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dcb4c-a16e-4696-ab7e-488c7dda49e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:30.905744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dcb4c-a16e-4696-ab7e-488c7dda49e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:30.906860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dcb4c-a16e-4696-ab7e-488c7dda49e5 None admin] RBAC: Adding query filter params (interface=public, service_id=c67447c88900463aad8e1fd375e19e04, region_id=RegionOne) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:30.907384 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dcb4c-a16e-4696-ab7e-488c7dda49e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:30.909042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dcb4c-a16e-4696-ab7e-488c7dda49e5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:30.918644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 383/772] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Mar 22 19:40:30 2022] GET /identity/v3/endpoints?service_id=c67447c88900463aad8e1fd375e19e04&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:30.924701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095da0b-cbde-4c5e-953e-e20e69194486 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:31.101827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65556-660c-43d9-9987-335ebe2e5261 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:31.102855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65556-660c-43d9-9987-335ebe2e5261 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:31.103345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e65556-660c-43d9-9987-335ebe2e5261 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:31.105408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 384/773] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:40:31.107500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095da0b-cbde-4c5e-953e-e20e69194486 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:31.111105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df54940-3995-49ce-a211-504c2f860721 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:31.111391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df54940-3995-49ce-a211-504c2f860721 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:31.111668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df54940-3995-49ce-a211-504c2f860721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:31.137507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1df54940-3995-49ce-a211-504c2f860721 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:31.138774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1df54940-3995-49ce-a211-504c2f860721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:31.154530 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877d08-56de-4228-8e30-b4b2d059e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:31.155783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877d08-56de-4228-8e30-b4b2d059e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:31.156270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877d08-56de-4228-8e30-b4b2d059e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:31.156912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877d08-56de-4228-8e30-b4b2d059e6b2 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:31.157954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6877d08-56de-4228-8e30-b4b2d059e6b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:31.159767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6877d08-56de-4228-8e30-b4b2d059e6b2 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:31.166471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 390/774] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Mar 22 19:40:30 2022] GET /identity/v3/services => generated 772 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:31.228301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 385/775] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:31.263279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877d08-56de-4228-8e30-b4b2d059e6b2 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:31.419850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877d08-56de-4228-8e30-b4b2d059e6b2 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:31.464906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340a3a5-d4cb-48a2-a640-35e5eb8df73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:31.466231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340a3a5-d4cb-48a2-a640-35e5eb8df73e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:31.466749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340a3a5-d4cb-48a2-a640-35e5eb8df73e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:31.467311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340a3a5-d4cb-48a2-a640-35e5eb8df73e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:31.481777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340a3a5-d4cb-48a2-a640-35e5eb8df73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:31.490355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-d340a3a5-d4cb-48a2-a640-35e5eb8df73e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:40:31.492546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 391/776] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:31.498306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df54940-3995-49ce-a211-504c2f860721 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:31.614573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df54940-3995-49ce-a211-504c2f860721 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:31.651042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4ef6f-1a7a-430a-82c7-c9b98c4e6f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:31.652124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4ef6f-1a7a-430a-82c7-c9b98c4e6f1d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:31.652606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4ef6f-1a7a-430a-82c7-c9b98c4e6f1d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:31.653076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4ef6f-1a7a-430a-82c7-c9b98c4e6f1d None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:31.654092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4ef6f-1a7a-430a-82c7-c9b98c4e6f1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:31.654601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4ef6f-1a7a-430a-82c7-c9b98c4e6f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:31.656184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4ef6f-1a7a-430a-82c7-c9b98c4e6f1d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:31.665911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 386/777] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:31.671260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340a3a5-d4cb-48a2-a640-35e5eb8df73e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:31.858637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340a3a5-d4cb-48a2-a640-35e5eb8df73e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:31.901791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe32fe6-b946-4d0c-a1dd-d2fcd4f1854a None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:31.902220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe32fe6-b946-4d0c-a1dd-d2fcd4f1854a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:31.902622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe32fe6-b946-4d0c-a1dd-d2fcd4f1854a None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:31.905738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 387/778] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:31.912477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1e211-b53e-4be6-9f8d-96d5837d09b1 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:31.912771 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1e211-b53e-4be6-9f8d-96d5837d09b1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:31.913049 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1e211-b53e-4be6-9f8d-96d5837d09b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:31.937725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf59776-d296-4131-a15c-d872411b9a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:31.939508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf59776-d296-4131-a15c-d872411b9a6e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:31.940233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf59776-d296-4131-a15c-d872411b9a6e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:31.940930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf59776-d296-4131-a15c-d872411b9a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:31.951065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1fc1e211-b53e-4be6-9f8d-96d5837d09b1 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:31.952275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1fc1e211-b53e-4be6-9f8d-96d5837d09b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:31.964374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf59776-d296-4131-a15c-d872411b9a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:31.968253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf59776-d296-4131-a15c-d872411b9a6e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:32.004121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-8cf59776-d296-4131-a15c-d872411b9a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:32.007909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 392/779] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:32.019656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf59776-d296-4131-a15c-d872411b9a6e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:32.100887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 388/780] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:32.137066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1e211-b53e-4be6-9f8d-96d5837d09b1 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:32.239137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf59776-d296-4131-a15c-d872411b9a6e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:32.306569 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa233c86-936e-4d66-ab35-aee0ef1173f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:32.308034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa233c86-936e-4d66-ab35-aee0ef1173f1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:32.308699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa233c86-936e-4d66-ab35-aee0ef1173f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:32.309392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa233c86-936e-4d66-ab35-aee0ef1173f1 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:32.310891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa233c86-936e-4d66-ab35-aee0ef1173f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:32.311673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa233c86-936e-4d66-ab35-aee0ef1173f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:32.314445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa233c86-936e-4d66-ab35-aee0ef1173f1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:32.337163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 393/781] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:32.346351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1e211-b53e-4be6-9f8d-96d5837d09b1 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:32.346724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa233c86-936e-4d66-ab35-aee0ef1173f1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:32.414162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ff2da-ed8f-4a0e-a002-cea7c3426ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:32.415031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ff2da-ed8f-4a0e-a002-cea7c3426ba8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:32.415309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ff2da-ed8f-4a0e-a002-cea7c3426ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:32.415577 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ff2da-ed8f-4a0e-a002-cea7c3426ba8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:32.416240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ff2da-ed8f-4a0e-a002-cea7c3426ba8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:32.417627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ff2da-ed8f-4a0e-a002-cea7c3426ba8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:32.442412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-330ff2da-ed8f-4a0e-a002-cea7c3426ba8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 22 19:40:32.444033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 389/782] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Mar 22 19:40:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:32.449629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ff2da-ed8f-4a0e-a002-cea7c3426ba8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:32.582277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ff2da-ed8f-4a0e-a002-cea7c3426ba8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:32.605629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa233c86-936e-4d66-ab35-aee0ef1173f1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:32.627942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294fd85-f7eb-4159-8491-cba2c0415a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:32.628634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294fd85-f7eb-4159-8491-cba2c0415a17 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:32.628932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294fd85-f7eb-4159-8491-cba2c0415a17 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:32.629200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294fd85-f7eb-4159-8491-cba2c0415a17 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:32.629968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294fd85-f7eb-4159-8491-cba2c0415a17 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:32.630327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294fd85-f7eb-4159-8491-cba2c0415a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:32.633143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294fd85-f7eb-4159-8491-cba2c0415a17 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:32.641856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 390/783] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Mar 22 19:40:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:32.648315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294fd85-f7eb-4159-8491-cba2c0415a17 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:32.702760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85fc9a-c0f0-4cf3-ad4d-be3655459cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:32.703583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85fc9a-c0f0-4cf3-ad4d-be3655459cc4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:32.703949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85fc9a-c0f0-4cf3-ad4d-be3655459cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:32.704176 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85fc9a-c0f0-4cf3-ad4d-be3655459cc4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:32.719169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85fc9a-c0f0-4cf3-ad4d-be3655459cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:32.720667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85fc9a-c0f0-4cf3-ad4d-be3655459cc4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:32.753608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-ec85fc9a-c0f0-4cf3-ad4d-be3655459cc4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 22 19:40:32.763240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294fd85-f7eb-4159-8491-cba2c0415a17 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:32.763545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 394/784] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:32.772431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85fc9a-c0f0-4cf3-ad4d-be3655459cc4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:32.808327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b00a43-2a70-4077-8583-a637dacabdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:32.809351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b00a43-2a70-4077-8583-a637dacabdd5 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:32.809807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b00a43-2a70-4077-8583-a637dacabdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:32.810265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b00a43-2a70-4077-8583-a637dacabdd5 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:32.811225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b00a43-2a70-4077-8583-a637dacabdd5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:32.811939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b00a43-2a70-4077-8583-a637dacabdd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:32.813343 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b00a43-2a70-4077-8583-a637dacabdd5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:32.819127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 391/785] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Mar 22 19:40:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:32.821768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db462a5-0506-4858-9c15-4ac617a573f8 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:32.821768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db462a5-0506-4858-9c15-4ac617a573f8 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:32.821768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db462a5-0506-4858-9c15-4ac617a573f8 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:32.823377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 392/786] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:32.829693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d1fc-3d72-44c6-80ec-550567f52afb None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:32.830048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d1fc-3d72-44c6-80ec-550567f52afb None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:32.830280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d1fc-3d72-44c6-80ec-550567f52afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:32.854348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-72f1d1fc-3d72-44c6-80ec-550567f52afb None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:32.855822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-72f1d1fc-3d72-44c6-80ec-550567f52afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:32.896266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85fc9a-c0f0-4cf3-ad4d-be3655459cc4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:32.933096 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9207f8-9271-46fd-8ded-430720dffc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:32.933891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 393/787] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:32.934091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9207f8-9271-46fd-8ded-430720dffc95 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:32.934492 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9207f8-9271-46fd-8ded-430720dffc95 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:32.934853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9207f8-9271-46fd-8ded-430720dffc95 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:32.935630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d1fc-3d72-44c6-80ec-550567f52afb None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:32.935936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9207f8-9271-46fd-8ded-430720dffc95 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:32.936348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9207f8-9271-46fd-8ded-430720dffc95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:32.937950 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9207f8-9271-46fd-8ded-430720dffc95 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:32.966297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 395/788] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Mar 22 19:40:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:32.967371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9207f8-9271-46fd-8ded-430720dffc95 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:33.052746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d1fc-3d72-44c6-80ec-550567f52afb None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:33.089439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba41ca-d7ed-4286-9256-030d2d580c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:33.090160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba41ca-d7ed-4286-9256-030d2d580c56 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:33.090445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba41ca-d7ed-4286-9256-030d2d580c56 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:33.090719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba41ca-d7ed-4286-9256-030d2d580c56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:33.091546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba41ca-d7ed-4286-9256-030d2d580c56 None admin] RBAC: Adding query filter params (interface=public, service_id=4942db5443fc48b4bd9227d3fe85e826, region_id=RegionOne) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:33.091867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba41ca-d7ed-4286-9256-030d2d580c56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:33.093396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba41ca-d7ed-4286-9256-030d2d580c56 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:33.099870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 394/789] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Mar 22 19:40:32 2022] GET /identity/v3/endpoints?service_id=4942db5443fc48b4bd9227d3fe85e826&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:33.100912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba41ca-d7ed-4286-9256-030d2d580c56 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:33.140997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9207f8-9271-46fd-8ded-430720dffc95 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:33.204164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77951450-c957-4035-80a2-32f334cc2d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:33.205572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77951450-c957-4035-80a2-32f334cc2d47 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:33.206069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77951450-c957-4035-80a2-32f334cc2d47 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:33.206352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77951450-c957-4035-80a2-32f334cc2d47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:33.211242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba41ca-d7ed-4286-9256-030d2d580c56 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:33.232920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77951450-c957-4035-80a2-32f334cc2d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:33.249630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48d3fa-4656-44e5-a241-31c661a57807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:33.251076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48d3fa-4656-44e5-a241-31c661a57807 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:33.251526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48d3fa-4656-44e5-a241-31c661a57807 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:33.251955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48d3fa-4656-44e5-a241-31c661a57807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:33.253090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-77951450-c957-4035-80a2-32f334cc2d47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:33.262389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 396/790] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:33.263929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77951450-c957-4035-80a2-32f334cc2d47 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:33.270839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48d3fa-4656-44e5-a241-31c661a57807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:33.273484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48d3fa-4656-44e5-a241-31c661a57807 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:33.304027 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-bc48d3fa-4656-44e5-a241-31c661a57807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:33.306527 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 395/791] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:33.307977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48d3fa-4656-44e5-a241-31c661a57807 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:33.445374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77951450-c957-4035-80a2-32f334cc2d47 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:33.483942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48d3fa-4656-44e5-a241-31c661a57807 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:33.504496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797f214-7309-4efd-ac20-7abb7316bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:33.505557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797f214-7309-4efd-ac20-7abb7316bd48 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:33.506124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797f214-7309-4efd-ac20-7abb7316bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:33.506579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797f214-7309-4efd-ac20-7abb7316bd48 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:33.507788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797f214-7309-4efd-ac20-7abb7316bd48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:33.510283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797f214-7309-4efd-ac20-7abb7316bd48 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:33.519968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 397/792] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Mar 22 19:40:33 2022] GET /identity/v3/services => generated 772 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:33.521564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797f214-7309-4efd-ac20-7abb7316bd48 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:33.564170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97d450-e179-415a-b3e5-4d82ad6480e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:33.565255 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97d450-e179-415a-b3e5-4d82ad6480e1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:33.565710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97d450-e179-415a-b3e5-4d82ad6480e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:33.566197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97d450-e179-415a-b3e5-4d82ad6480e1 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:33.567521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97d450-e179-415a-b3e5-4d82ad6480e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:33.568023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97d450-e179-415a-b3e5-4d82ad6480e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:33.571448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97d450-e179-415a-b3e5-4d82ad6480e1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:33.618116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 396/793] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:33.639366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97d450-e179-415a-b3e5-4d82ad6480e1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:33.705563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797f214-7309-4efd-ac20-7abb7316bd48 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:33.746458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc389060-f653-4736-b27c-ae4821ce19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:33.747157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc389060-f653-4736-b27c-ae4821ce19bc None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:33.747440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc389060-f653-4736-b27c-ae4821ce19bc None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:33.747714 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc389060-f653-4736-b27c-ae4821ce19bc None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:33.748541 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc389060-f653-4736-b27c-ae4821ce19bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:33.748852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc389060-f653-4736-b27c-ae4821ce19bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:33.750413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc389060-f653-4736-b27c-ae4821ce19bc None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:33.764598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 398/794] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:33.770602 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc389060-f653-4736-b27c-ae4821ce19bc None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:33.880937 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97d450-e179-415a-b3e5-4d82ad6480e1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:33.919147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc389060-f653-4736-b27c-ae4821ce19bc None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:33.951971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8439183-c443-44d6-8e08-9cdaba243105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:33.952822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8439183-c443-44d6-8e08-9cdaba243105 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:33.953327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8439183-c443-44d6-8e08-9cdaba243105 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:33.953677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8439183-c443-44d6-8e08-9cdaba243105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:33.970873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8439183-c443-44d6-8e08-9cdaba243105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:33.972200 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc15af-f2d6-47bb-ad8e-6cd0f2df677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:33.972618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8439183-c443-44d6-8e08-9cdaba243105 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:33.974113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc15af-f2d6-47bb-ad8e-6cd0f2df677c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:33.974710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc15af-f2d6-47bb-ad8e-6cd0f2df677c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:33.975272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc15af-f2d6-47bb-ad8e-6cd0f2df677c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:33.987872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc15af-f2d6-47bb-ad8e-6cd0f2df677c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:33.990736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc15af-f2d6-47bb-ad8e-6cd0f2df677c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:33.993087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-b8439183-c443-44d6-8e08-9cdaba243105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:33.995311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 397/795] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:33.997144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b807b29-c3f6-49c7-a0ea-78007485d050 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:33.997541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b807b29-c3f6-49c7-a0ea-78007485d050 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:33.997980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b807b29-c3f6-49c7-a0ea-78007485d050 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:33.999815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 398/796] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:34.001525 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b807b29-c3f6-49c7-a0ea-78007485d050 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:34.027101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-dffc15af-f2d6-47bb-ad8e-6cd0f2df677c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:34.029901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 399/797] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:34.035189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb195e8-adbc-431f-acd5-06a2936188d2 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:34.035501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb195e8-adbc-431f-acd5-06a2936188d2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:34.035741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb195e8-adbc-431f-acd5-06a2936188d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:34.074362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7eb195e8-adbc-431f-acd5-06a2936188d2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:34.077016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7eb195e8-adbc-431f-acd5-06a2936188d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:34.156610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b807b29-c3f6-49c7-a0ea-78007485d050 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:34.181203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 400/798] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:34.182497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb195e8-adbc-431f-acd5-06a2936188d2 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:34.257542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538911b-1cdf-4c81-855d-31921ff15531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:34.258609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538911b-1cdf-4c81-855d-31921ff15531 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:34.259255 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538911b-1cdf-4c81-855d-31921ff15531 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:34.259710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538911b-1cdf-4c81-855d-31921ff15531 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:34.265985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538911b-1cdf-4c81-855d-31921ff15531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:34.266518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538911b-1cdf-4c81-855d-31921ff15531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:34.271504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538911b-1cdf-4c81-855d-31921ff15531 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:34.293338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 399/799] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:34.294872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538911b-1cdf-4c81-855d-31921ff15531 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:34.375602 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb195e8-adbc-431f-acd5-06a2936188d2 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:34.435791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf45e43-e6fd-42fc-a161-b6ff672c41b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:34.436822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf45e43-e6fd-42fc-a161-b6ff672c41b9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:34.437268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf45e43-e6fd-42fc-a161-b6ff672c41b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:34.437699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf45e43-e6fd-42fc-a161-b6ff672c41b9 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:34.439104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf45e43-e6fd-42fc-a161-b6ff672c41b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:34.439599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf45e43-e6fd-42fc-a161-b6ff672c41b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:34.442774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf45e43-e6fd-42fc-a161-b6ff672c41b9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:34.474071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 401/800] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:34.476072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf45e43-e6fd-42fc-a161-b6ff672c41b9 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:34.490825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538911b-1cdf-4c81-855d-31921ff15531 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:34.550639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cb02f-a3a5-44c3-9bd2-e1d98396f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:34.551785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cb02f-a3a5-44c3-9bd2-e1d98396f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:34.552204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cb02f-a3a5-44c3-9bd2-e1d98396f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:34.552663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cb02f-a3a5-44c3-9bd2-e1d98396f8d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:34.569776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cb02f-a3a5-44c3-9bd2-e1d98396f8d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:34.581974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-4b2cb02f-a3a5-44c3-9bd2-e1d98396f8d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:40:34.589507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 400/801] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:34.589507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cb02f-a3a5-44c3-9bd2-e1d98396f8d3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:34.656745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf45e43-e6fd-42fc-a161-b6ff672c41b9 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:34.699447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9664770-24fc-41fe-978d-26e0c29a24a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:34.700887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664770-24fc-41fe-978d-26e0c29a24a7 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:34.701349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664770-24fc-41fe-978d-26e0c29a24a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:34.701641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664770-24fc-41fe-978d-26e0c29a24a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:34.711225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664770-24fc-41fe-978d-26e0c29a24a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:34.712697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664770-24fc-41fe-978d-26e0c29a24a7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:34.728593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a9664770-24fc-41fe-978d-26e0c29a24a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 22 19:40:34.729849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 402/802] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:40:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:34.731113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ba3ef-c76d-4662-8648-5e29a2446897 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:34.731399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ba3ef-c76d-4662-8648-5e29a2446897 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:34.731663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ba3ef-c76d-4662-8648-5e29a2446897 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:34.737453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 403/803] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:34.737453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ba3ef-c76d-4662-8648-5e29a2446897 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:34.746886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cb02f-a3a5-44c3-9bd2-e1d98396f8d3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:34.803405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2366fd-f97c-45ae-a90c-9456a7e02867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:34.804295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2366fd-f97c-45ae-a90c-9456a7e02867 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:34.804573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2366fd-f97c-45ae-a90c-9456a7e02867 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:34.804851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2366fd-f97c-45ae-a90c-9456a7e02867 None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/439b41be395d4faeae0b855a1e0f25f1/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:34.806942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2366fd-f97c-45ae-a90c-9456a7e02867 None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=439b41be395d4faeae0b855a1e0f25f1, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:34.808447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2366fd-f97c-45ae-a90c-9456a7e02867 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:34.823086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 401/804] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:40:34 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/439b41be395d4faeae0b855a1e0f25f1/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:40:34.835163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2366fd-f97c-45ae-a90c-9456a7e02867 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:34.898049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ba3ef-c76d-4662-8648-5e29a2446897 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:34.957172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939b3b-0205-4156-8dfa-b21710789a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:34.958688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939b3b-0205-4156-8dfa-b21710789a85 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:34.959187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939b3b-0205-4156-8dfa-b21710789a85 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:34.959630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939b3b-0205-4156-8dfa-b21710789a85 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:34.961885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3939b3b-0205-4156-8dfa-b21710789a85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:34.962474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3939b3b-0205-4156-8dfa-b21710789a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:34.964870 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3939b3b-0205-4156-8dfa-b21710789a85 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:34.981389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 404/805] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:34.983743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a0e0-4762-4f03-b087-e147007fc7d3 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:34.984339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a0e0-4762-4f03-b087-e147007fc7d3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:34.984866 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a0e0-4762-4f03-b087-e147007fc7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:35.009143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-2355a0e0-4762-4f03-b087-e147007fc7d3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:35.011336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2355a0e0-4762-4f03-b087-e147007fc7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:35.047921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2366fd-f97c-45ae-a90c-9456a7e02867 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:35.105531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 405/806] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:35.106470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a0e0-4762-4f03-b087-e147007fc7d3 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:35.129285 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76011734-5739-46a4-9791-71c13e390e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:35.130067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76011734-5739-46a4-9791-71c13e390e82 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:35.130352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76011734-5739-46a4-9791-71c13e390e82 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:35.130624 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76011734-5739-46a4-9791-71c13e390e82 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:35.134415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76011734-5739-46a4-9791-71c13e390e82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:35.134733 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76011734-5739-46a4-9791-71c13e390e82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:35.136345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76011734-5739-46a4-9791-71c13e390e82 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:35.172024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 402/807] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Mar 22 19:40:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:35.173282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76011734-5739-46a4-9791-71c13e390e82 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:35.235204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a0e0-4762-4f03-b087-e147007fc7d3 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:35.271259 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e703d49-e112-4014-a27d-6cd6d36dd06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:35.272121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e703d49-e112-4014-a27d-6cd6d36dd06d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:35.272402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e703d49-e112-4014-a27d-6cd6d36dd06d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:35.272708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e703d49-e112-4014-a27d-6cd6d36dd06d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:35.283609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e703d49-e112-4014-a27d-6cd6d36dd06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:35.285108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e703d49-e112-4014-a27d-6cd6d36dd06d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:35.303154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-3e703d49-e112-4014-a27d-6cd6d36dd06d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:35.304762 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 406/808] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:35.310251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e703d49-e112-4014-a27d-6cd6d36dd06d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:35.360975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76011734-5739-46a4-9791-71c13e390e82 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:35.420636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e703d49-e112-4014-a27d-6cd6d36dd06d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:35.423433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb82e8-559c-4646-8478-522537d3ab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:35.424338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb82e8-559c-4646-8478-522537d3ab38 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:35.424686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb82e8-559c-4646-8478-522537d3ab38 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:35.425026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb82e8-559c-4646-8478-522537d3ab38 None admin] PATH_INFO: `/v3/services/network` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:35.427511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb82e8-559c-4646-8478-522537d3ab38 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:35.427511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb82e8-559c-4646-8478-522537d3ab38 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:35.439431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-3cbb82e8-559c-4646-8478-522537d3ab38 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 22 19:40:35.440784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 403/809] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:35 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:35.441628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb82e8-559c-4646-8478-522537d3ab38 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:35.464386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154d53-f377-4b23-8619-6f0a0d3bb45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:35.465554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154d53-f377-4b23-8619-6f0a0d3bb45b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:35.466094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154d53-f377-4b23-8619-6f0a0d3bb45b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:35.466446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154d53-f377-4b23-8619-6f0a0d3bb45b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:35.480281 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154d53-f377-4b23-8619-6f0a0d3bb45b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:35.482148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154d53-f377-4b23-8619-6f0a0d3bb45b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:35.504826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-70154d53-f377-4b23-8619-6f0a0d3bb45b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:35.511415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 407/810] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:35.511415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154d53-f377-4b23-8619-6f0a0d3bb45b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:35.585921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb82e8-559c-4646-8478-522537d3ab38 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:35.639991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535a416-9d83-4429-b43d-ff5108ad4a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:35.641068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535a416-9d83-4429-b43d-ff5108ad4a0b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:35.641567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535a416-9d83-4429-b43d-ff5108ad4a0b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:35.642245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535a416-9d83-4429-b43d-ff5108ad4a0b None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:35.643358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535a416-9d83-4429-b43d-ff5108ad4a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:35.644050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535a416-9d83-4429-b43d-ff5108ad4a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:35.646272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535a416-9d83-4429-b43d-ff5108ad4a0b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:35.648483 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154d53-f377-4b23-8619-6f0a0d3bb45b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:35.664236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 404/811] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:35.666219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535a416-9d83-4429-b43d-ff5108ad4a0b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:35.691089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2396a6-aa37-41fb-a57e-072289957a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:35.691794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2396a6-aa37-41fb-a57e-072289957a3e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:35.692075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2396a6-aa37-41fb-a57e-072289957a3e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:35.692347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2396a6-aa37-41fb-a57e-072289957a3e None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:35.693149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2396a6-aa37-41fb-a57e-072289957a3e None admin] RBAC: Adding query filter params (name=network) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:35.693462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2396a6-aa37-41fb-a57e-072289957a3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:35.695085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2396a6-aa37-41fb-a57e-072289957a3e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:35.706707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 408/812] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:40:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:35.707960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2396a6-aa37-41fb-a57e-072289957a3e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:35.840327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2396a6-aa37-41fb-a57e-072289957a3e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:35.848991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535a416-9d83-4429-b43d-ff5108ad4a0b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:35.878595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c266fa-42bf-41f8-ac79-039439257cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:35.879433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c266fa-42bf-41f8-ac79-039439257cfb None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:35.879707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c266fa-42bf-41f8-ac79-039439257cfb None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:35.879979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c266fa-42bf-41f8-ac79-039439257cfb None admin] PATH_INFO: `/v3/users/nova` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:35.888511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c266fa-42bf-41f8-ac79-039439257cfb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:35.890116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c266fa-42bf-41f8-ac79-039439257cfb None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:35.905354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-f6c266fa-42bf-41f8-ac79-039439257cfb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 22 19:40:35.906937 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 409/813] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Mar 22 19:40:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:35.917532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c266fa-42bf-41f8-ac79-039439257cfb None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:35.917777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b154e4-bf7d-4dbc-8f59-136feda9afa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:35.918430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b154e4-bf7d-4dbc-8f59-136feda9afa6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:35.918713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b154e4-bf7d-4dbc-8f59-136feda9afa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:35.919042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b154e4-bf7d-4dbc-8f59-136feda9afa6 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:35.919782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b154e4-bf7d-4dbc-8f59-136feda9afa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:35.920091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b154e4-bf7d-4dbc-8f59-136feda9afa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:35.921504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b154e4-bf7d-4dbc-8f59-136feda9afa6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:35.935439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 405/814] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:35.936341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b154e4-bf7d-4dbc-8f59-136feda9afa6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:36.046941 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c266fa-42bf-41f8-ac79-039439257cfb None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:36.065716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b154e4-bf7d-4dbc-8f59-136feda9afa6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:36.104777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a2300-547a-4d89-93d1-12c4388cccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:36.105554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a2300-547a-4d89-93d1-12c4388cccb9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:36.105901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a2300-547a-4d89-93d1-12c4388cccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:36.106275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a2300-547a-4d89-93d1-12c4388cccb9 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:36.107239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a2300-547a-4d89-93d1-12c4388cccb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:36.107608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a2300-547a-4d89-93d1-12c4388cccb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:36.109182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a2300-547a-4d89-93d1-12c4388cccb9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:36.124863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4ce0c-54e7-4ca9-9a20-b23ddc60de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:36.126920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4ce0c-54e7-4ca9-9a20-b23ddc60de20 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:36.127388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4ce0c-54e7-4ca9-9a20-b23ddc60de20 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:36.128222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4ce0c-54e7-4ca9-9a20-b23ddc60de20 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:36.129611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4ce0c-54e7-4ca9-9a20-b23ddc60de20 None admin] RBAC: Adding query filter params (type=network) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:36.130166 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4ce0c-54e7-4ca9-9a20-b23ddc60de20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:36.130344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 406/815] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Mar 22 19:40:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:36.131224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a2300-547a-4d89-93d1-12c4388cccb9 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:36.134770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4ce0c-54e7-4ca9-9a20-b23ddc60de20 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:36.146716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 410/816] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:40:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:36.148218 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4ce0c-54e7-4ca9-9a20-b23ddc60de20 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:36.269410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a2300-547a-4d89-93d1-12c4388cccb9 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:36.303614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4ce0c-54e7-4ca9-9a20-b23ddc60de20 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:36.313715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b21b3-dd86-4a23-bb3c-40c2d7126ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:36.314624 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b21b3-dd86-4a23-bb3c-40c2d7126ae8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:36.314919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b21b3-dd86-4a23-bb3c-40c2d7126ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:36.315200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b21b3-dd86-4a23-bb3c-40c2d7126ae8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:36.323651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b21b3-dd86-4a23-bb3c-40c2d7126ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:36.325131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b21b3-dd86-4a23-bb3c-40c2d7126ae8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:36.340335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-9c9b21b3-dd86-4a23-bb3c-40c2d7126ae8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:36.341566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 407/817] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:36.342366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b21b3-dd86-4a23-bb3c-40c2d7126ae8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:36.350901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba60df-bc7c-4425-8324-cd710e685498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:36.352263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba60df-bc7c-4425-8324-cd710e685498 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:36.352976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba60df-bc7c-4425-8324-cd710e685498 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:36.353656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba60df-bc7c-4425-8324-cd710e685498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:36.447403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba60df-bc7c-4425-8324-cd710e685498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:36.450608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba60df-bc7c-4425-8324-cd710e685498 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:36.494287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b21b3-dd86-4a23-bb3c-40c2d7126ae8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:36.543369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec9ebe-4207-41eb-b5fb-a0321cd7a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:36.544046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec9ebe-4207-41eb-b5fb-a0321cd7a2ba None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:36.544624 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec9ebe-4207-41eb-b5fb-a0321cd7a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:36.544906 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec9ebe-4207-41eb-b5fb-a0321cd7a2ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:36.545986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec9ebe-4207-41eb-b5fb-a0321cd7a2ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:36.547519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec9ebe-4207-41eb-b5fb-a0321cd7a2ba None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:36.575215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 408/818] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Mar 22 19:40:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:40:36.576981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d184c17-1295-456e-8d46-64181e8eb276 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:36.577481 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d184c17-1295-456e-8d46-64181e8eb276 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:36.578003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d184c17-1295-456e-8d46-64181e8eb276 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:36.583794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 411/819] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:40:36.583794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba60df-bc7c-4425-8324-cd710e685498 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:36.585498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 409/820] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:36.586761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d184c17-1295-456e-8d46-64181e8eb276 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:36.751720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba60df-bc7c-4425-8324-cd710e685498 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:36.753748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d184c17-1295-456e-8d46-64181e8eb276 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:36.806235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc626c0-a902-42d6-926d-c7ec5341d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:36.807168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc626c0-a902-42d6-926d-c7ec5341d843 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:36.807595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc626c0-a902-42d6-926d-c7ec5341d843 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:36.808125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc626c0-a902-42d6-926d-c7ec5341d843 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:36.809000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc626c0-a902-42d6-926d-c7ec5341d843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:36.809412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc626c0-a902-42d6-926d-c7ec5341d843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:36.811765 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc626c0-a902-42d6-926d-c7ec5341d843 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:36.819496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87895327-506e-4a32-ae87-20aa353f3572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:36.821852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87895327-506e-4a32-ae87-20aa353f3572 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:36.822397 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87895327-506e-4a32-ae87-20aa353f3572 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:36.822893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87895327-506e-4a32-ae87-20aa353f3572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:36.829421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 412/821] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:36.831012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd56aa7-df62-4912-8857-ddf7c6971096 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:36.831306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd56aa7-df62-4912-8857-ddf7c6971096 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:36.831585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd56aa7-df62-4912-8857-ddf7c6971096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:36.843212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87895327-506e-4a32-ae87-20aa353f3572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:36.845033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87895327-506e-4a32-ae87-20aa353f3572 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:36.857604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-cbd56aa7-df62-4912-8857-ddf7c6971096 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:36.858549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cbd56aa7-df62-4912-8857-ddf7c6971096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:36.869364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-87895327-506e-4a32-ae87-20aa353f3572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:36.871052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 410/822] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:36.871905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87895327-506e-4a32-ae87-20aa353f3572 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:36.962146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 413/823] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:36.964057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd56aa7-df62-4912-8857-ddf7c6971096 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:37.018170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87895327-506e-4a32-ae87-20aa353f3572 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:37.055901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0003c2-8352-4a1c-aed4-3c87e408e226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:37.056804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0003c2-8352-4a1c-aed4-3c87e408e226 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.057102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0003c2-8352-4a1c-aed4-3c87e408e226 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.057365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0003c2-8352-4a1c-aed4-3c87e408e226 None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/d526f13b514045ec9ebee14edf3fe79f/roles/5a4466ef1a5f41b795e229b997885f2e` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.074711 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0003c2-8352-4a1c-aed4-3c87e408e226 None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=d526f13b514045ec9ebee14edf3fe79f, role_id=5a4466ef1a5f41b795e229b997885f2e)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:37.077228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0003c2-8352-4a1c-aed4-3c87e408e226 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:37.094151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd56aa7-df62-4912-8857-ddf7c6971096 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:37.099242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 411/824] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:40:36 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/d526f13b514045ec9ebee14edf3fe79f/roles/5a4466ef1a5f41b795e229b997885f2e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:40:37.107749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0003c2-8352-4a1c-aed4-3c87e408e226 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:37.136740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fbf25-5374-4733-9c08-9aa1eefeac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:37.137443 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fbf25-5374-4733-9c08-9aa1eefeac33 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.137772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fbf25-5374-4733-9c08-9aa1eefeac33 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.138080 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fbf25-5374-4733-9c08-9aa1eefeac33 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.138890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fbf25-5374-4733-9c08-9aa1eefeac33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:37.139193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fbf25-5374-4733-9c08-9aa1eefeac33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:37.140694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fbf25-5374-4733-9c08-9aa1eefeac33 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:37.159676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 414/825] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:37.161224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fbf25-5374-4733-9c08-9aa1eefeac33 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:37.256024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0003c2-8352-4a1c-aed4-3c87e408e226 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:37.279093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fbf25-5374-4733-9c08-9aa1eefeac33 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:37.302611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032a46f-f789-4968-b3d4-44fab4529eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:37.304513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032a46f-f789-4968-b3d4-44fab4529eb8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.305070 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032a46f-f789-4968-b3d4-44fab4529eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.305541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032a46f-f789-4968-b3d4-44fab4529eb8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.306463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032a46f-f789-4968-b3d4-44fab4529eb8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:37.308508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032a46f-f789-4968-b3d4-44fab4529eb8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:37.318622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def15518-add3-413a-a3b6-210cc4700141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:37.319424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def15518-add3-413a-a3b6-210cc4700141 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.320261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def15518-add3-413a-a3b6-210cc4700141 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.320261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def15518-add3-413a-a3b6-210cc4700141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.326117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a032a46f-f789-4968-b3d4-44fab4529eb8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 22 19:40:37.328758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def15518-add3-413a-a3b6-210cc4700141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:37.329160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 412/826] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Mar 22 19:40:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:37.330274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def15518-add3-413a-a3b6-210cc4700141 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:37.335359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032a46f-f789-4968-b3d4-44fab4529eb8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:37.346004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-def15518-add3-413a-a3b6-210cc4700141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:37.347631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 415/827] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:37.354305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def15518-add3-413a-a3b6-210cc4700141 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:37.464391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032a46f-f789-4968-b3d4-44fab4529eb8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:37.503285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def15518-add3-413a-a3b6-210cc4700141 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:37.511260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d30241-b612-4cc1-b1a4-648bebbb04b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:37.512219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30241-b612-4cc1-b1a4-648bebbb04b4 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.512219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30241-b612-4cc1-b1a4-648bebbb04b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.512584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30241-b612-4cc1-b1a4-648bebbb04b4 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.513201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30241-b612-4cc1-b1a4-648bebbb04b4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:37.513508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30241-b612-4cc1-b1a4-648bebbb04b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:37.515110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30241-b612-4cc1-b1a4-648bebbb04b4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:37.528045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 413/828] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Mar 22 19:40:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:37.528045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf74ca-b0bc-44b2-98f3-a2c315f76571 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.528045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf74ca-b0bc-44b2-98f3-a2c315f76571 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.528045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf74ca-b0bc-44b2-98f3-a2c315f76571 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.529604 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 414/829] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:37.530436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf74ca-b0bc-44b2-98f3-a2c315f76571 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:37.561225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cba37a-896f-4a13-b39b-b4cf52901459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:37.562539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cba37a-896f-4a13-b39b-b4cf52901459 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.562539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cba37a-896f-4a13-b39b-b4cf52901459 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.562539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cba37a-896f-4a13-b39b-b4cf52901459 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.563258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cba37a-896f-4a13-b39b-b4cf52901459 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:37.563564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cba37a-896f-4a13-b39b-b4cf52901459 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:37.565060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cba37a-896f-4a13-b39b-b4cf52901459 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:37.584316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 416/830] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:37.584316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c78d9-9764-47eb-afd9-2973f85748fd None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.584316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c78d9-9764-47eb-afd9-2973f85748fd None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.584316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c78d9-9764-47eb-afd9-2973f85748fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.612469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-128c78d9-9764-47eb-afd9-2973f85748fd None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:37.613870 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-128c78d9-9764-47eb-afd9-2973f85748fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:37.677431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf74ca-b0bc-44b2-98f3-a2c315f76571 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:37.708628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 417/831] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:37.709617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c78d9-9764-47eb-afd9-2973f85748fd None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:37.733302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20702-6f85-470e-a687-f31951b60ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:37.734862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20702-6f85-470e-a687-f31951b60ca1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.735514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20702-6f85-470e-a687-f31951b60ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.736027 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20702-6f85-470e-a687-f31951b60ca1 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.737416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc20702-6f85-470e-a687-f31951b60ca1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:37.737903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc20702-6f85-470e-a687-f31951b60ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:37.740318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc20702-6f85-470e-a687-f31951b60ca1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:37.749015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 415/832] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Mar 22 19:40:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:37.750358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20702-6f85-470e-a687-f31951b60ca1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:37.884103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20702-6f85-470e-a687-f31951b60ca1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:37.889482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c78d9-9764-47eb-afd9-2973f85748fd None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:37.935253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020375f-627d-4c8b-a8d7-bb601c4feff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:37.936074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020375f-627d-4c8b-a8d7-bb601c4feff1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.936355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020375f-627d-4c8b-a8d7-bb601c4feff1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.936623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020375f-627d-4c8b-a8d7-bb601c4feff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.946803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1e175-2fa7-4bee-9288-11e3b4c9626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:37.947481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1e175-2fa7-4bee-9288-11e3b4c9626d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:37.947760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1e175-2fa7-4bee-9288-11e3b4c9626d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:37.948032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1e175-2fa7-4bee-9288-11e3b4c9626d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:37.949033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1e175-2fa7-4bee-9288-11e3b4c9626d None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=7f74d49fc68344899f70efb85eb1c97d) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:37.949506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1e175-2fa7-4bee-9288-11e3b4c9626d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:37.950044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020375f-627d-4c8b-a8d7-bb601c4feff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:37.950981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1e175-2fa7-4bee-9288-11e3b4c9626d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:37.964397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 418/833] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:37 2022] GET /identity/v3/role_assignments?user.id=7f74d49fc68344899f70efb85eb1c97d&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:37.964673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-d020375f-627d-4c8b-a8d7-bb601c4feff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:40:37.964810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1e175-2fa7-4bee-9288-11e3b4c9626d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:37.964938 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 416/834] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:37.970097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020375f-627d-4c8b-a8d7-bb601c4feff1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:38.076987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1e175-2fa7-4bee-9288-11e3b4c9626d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:38.104051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020375f-627d-4c8b-a8d7-bb601c4feff1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:38.115935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb8ae3-8eca-45ae-a464-ad466b710472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:38.116920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb8ae3-8eca-45ae-a464-ad466b710472 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:38.117203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb8ae3-8eca-45ae-a464-ad466b710472 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:38.117478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb8ae3-8eca-45ae-a464-ad466b710472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:38.118331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb8ae3-8eca-45ae-a464-ad466b710472 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:38.119814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb8ae3-8eca-45ae-a464-ad466b710472 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:38.142151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7e79-453a-45ba-aee6-4e04c64acb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:38.142837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7e79-453a-45ba-aee6-4e04c64acb00 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:38.143172 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7e79-453a-45ba-aee6-4e04c64acb00 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:38.143513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7e79-453a-45ba-aee6-4e04c64acb00 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:38.144249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb7e79-453a-45ba-aee6-4e04c64acb00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:38.144554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb7e79-453a-45ba-aee6-4e04c64acb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:38.145446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 419/835] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Mar 22 19:40:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:40:38.146024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb7e79-453a-45ba-aee6-4e04c64acb00 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:38.160595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 417/836] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:38.161824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb8ae3-8eca-45ae-a464-ad466b710472 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:38.328817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb8ae3-8eca-45ae-a464-ad466b710472 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:38.395964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31db70b-1e86-4ff1-b014-72f63d604835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:38.395964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31db70b-1e86-4ff1-b014-72f63d604835 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:38.396465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31db70b-1e86-4ff1-b014-72f63d604835 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:38.398113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31db70b-1e86-4ff1-b014-72f63d604835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:38.411714 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31db70b-1e86-4ff1-b014-72f63d604835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:38.414979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31db70b-1e86-4ff1-b014-72f63d604835 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:38.447896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-d31db70b-1e86-4ff1-b014-72f63d604835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:38.450379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 420/837] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:38.459562 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7e79-453a-45ba-aee6-4e04c64acb00 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:38.639307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7e79-453a-45ba-aee6-4e04c64acb00 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:38.693899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07085b82-3781-48b2-bd50-1167d4b30b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:38.694959 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07085b82-3781-48b2-bd50-1167d4b30b16 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:38.695448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07085b82-3781-48b2-bd50-1167d4b30b16 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:38.695868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07085b82-3781-48b2-bd50-1167d4b30b16 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:38.697236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07085b82-3781-48b2-bd50-1167d4b30b16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:38.697759 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07085b82-3781-48b2-bd50-1167d4b30b16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:38.700408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07085b82-3781-48b2-bd50-1167d4b30b16 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:38.731313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31db70b-1e86-4ff1-b014-72f63d604835 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:38.732530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 418/838] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:38.908273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31db70b-1e86-4ff1-b014-72f63d604835 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:38.965479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5094b-b99c-462d-8612-335321f45a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:38.966744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5094b-b99c-462d-8612-335321f45a78 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:38.967195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5094b-b99c-462d-8612-335321f45a78 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:38.967622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5094b-b99c-462d-8612-335321f45a78 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:38.983742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5094b-b99c-462d-8612-335321f45a78 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:38.986498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5094b-b99c-462d-8612-335321f45a78 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:39.013423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-62e5094b-b99c-462d-8612-335321f45a78 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 22 19:40:39.016102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 421/839] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:40:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:39.025609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07085b82-3781-48b2-bd50-1167d4b30b16 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:39.186369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07085b82-3781-48b2-bd50-1167d4b30b16 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:39.250301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae3086-25fa-4fb9-bc4b-1ffa7dff28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:39.251378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3086-25fa-4fb9-bc4b-1ffa7dff28d0 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:39.251851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3086-25fa-4fb9-bc4b-1ffa7dff28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:39.252314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3086-25fa-4fb9-bc4b-1ffa7dff28d0 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:39.253341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae3086-25fa-4fb9-bc4b-1ffa7dff28d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:39.253878 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae3086-25fa-4fb9-bc4b-1ffa7dff28d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:39.255565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae3086-25fa-4fb9-bc4b-1ffa7dff28d0 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:39.278921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 419/840] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Mar 22 19:40:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:39.287290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5094b-b99c-462d-8612-335321f45a78 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:39.469005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5094b-b99c-462d-8612-335321f45a78 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:39.528251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2fac-a1f1-4ad1-8552-261b9fb6b369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:39.529232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2fac-a1f1-4ad1-8552-261b9fb6b369 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:39.529680 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2fac-a1f1-4ad1-8552-261b9fb6b369 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:39.530213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2fac-a1f1-4ad1-8552-261b9fb6b369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:39.579186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468aa5-f026-430a-a39a-5c52179b74b2 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:39.579526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468aa5-f026-430a-a39a-5c52179b74b2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:39.579749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468aa5-f026-430a-a39a-5c52179b74b2 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:39.581769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 420/841] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:39.587327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01f9c2-ebb2-4764-b5bd-9508c4f0d94b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:39.587678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01f9c2-ebb2-4764-b5bd-9508c4f0d94b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:39.587885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01f9c2-ebb2-4764-b5bd-9508c4f0d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:39.605298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-eb01f9c2-ebb2-4764-b5bd-9508c4f0d94b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:39.606558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-eb01f9c2-ebb2-4764-b5bd-9508c4f0d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:39.646852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2fac-a1f1-4ad1-8552-261b9fb6b369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:39.649452 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2fac-a1f1-4ad1-8552-261b9fb6b369 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:39.682307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 421/842] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:39.701300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01f9c2-ebb2-4764-b5bd-9508c4f0d94b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:39.807017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01f9c2-ebb2-4764-b5bd-9508c4f0d94b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:39.822312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 422/843] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:40:39.827942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2fac-a1f1-4ad1-8552-261b9fb6b369 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:39.853977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a2898-9a71-49c7-aa45-4c14d73db09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:39.853977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a2898-9a71-49c7-aa45-4c14d73db09e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:39.853977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a2898-9a71-49c7-aa45-4c14d73db09e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:39.853977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a2898-9a71-49c7-aa45-4c14d73db09e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:39.864738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a2898-9a71-49c7-aa45-4c14d73db09e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:39.872931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-b38a2898-9a71-49c7-aa45-4c14d73db09e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:40:39.879588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 422/844] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:39.881248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a2898-9a71-49c7-aa45-4c14d73db09e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:39.962771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2fac-a1f1-4ad1-8552-261b9fb6b369 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:39.989870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a2898-9a71-49c7-aa45-4c14d73db09e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:40.000680 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a602366-3767-41e6-8420-9f8255d9b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.001827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602366-3767-41e6-8420-9f8255d9b988 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.002327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602366-3767-41e6-8420-9f8255d9b988 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.002817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602366-3767-41e6-8420-9f8255d9b988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.017264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a602366-3767-41e6-8420-9f8255d9b988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.019286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a602366-3767-41e6-8420-9f8255d9b988 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.027921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21150d88-0699-4f35-be26-b4d5489cd70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.028903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150d88-0699-4f35-be26-b4d5489cd70b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.029418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150d88-0699-4f35-be26-b4d5489cd70b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.029925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150d88-0699-4f35-be26-b4d5489cd70b None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.030905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21150d88-0699-4f35-be26-b4d5489cd70b None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:40.031456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21150d88-0699-4f35-be26-b4d5489cd70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.033127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21150d88-0699-4f35-be26-b4d5489cd70b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.040776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-3a602366-3767-41e6-8420-9f8255d9b988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:40.042354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 423/845] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:40.042859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 423/846] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:40.050914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a602366-3767-41e6-8420-9f8255d9b988 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:40.051119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21150d88-0699-4f35-be26-b4d5489cd70b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:40.174190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21150d88-0699-4f35-be26-b4d5489cd70b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:40.209015 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a602366-3767-41e6-8420-9f8255d9b988 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:40.212317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0aa94-c9b3-43a5-b390-4997a72953ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.213123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0aa94-c9b3-43a5-b390-4997a72953ad None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.213292 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0aa94-c9b3-43a5-b390-4997a72953ad None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.213541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0aa94-c9b3-43a5-b390-4997a72953ad None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.214307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0aa94-c9b3-43a5-b390-4997a72953ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:40.214616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0aa94-c9b3-43a5-b390-4997a72953ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.216765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0aa94-c9b3-43a5-b390-4997a72953ad None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.229980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 424/847] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:40.238443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0aa94-c9b3-43a5-b390-4997a72953ad None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:40.284354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15cf1-42a4-4277-b762-902f12607370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.285494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15cf1-42a4-4277-b762-902f12607370 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.285992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15cf1-42a4-4277-b762-902f12607370 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.286410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15cf1-42a4-4277-b762-902f12607370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.305434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15cf1-42a4-4277-b762-902f12607370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.308508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15cf1-42a4-4277-b762-902f12607370 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.331982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-28d15cf1-42a4-4277-b762-902f12607370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:40.333975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 424/848] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:40.339990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15cf1-42a4-4277-b762-902f12607370 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:40.393185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0aa94-c9b3-43a5-b390-4997a72953ad None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:40.430023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd16333-0a12-41d9-ae78-f109ce78ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.430880 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd16333-0a12-41d9-ae78-f109ce78ec7a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.431164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd16333-0a12-41d9-ae78-f109ce78ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.431518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd16333-0a12-41d9-ae78-f109ce78ec7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.439221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd16333-0a12-41d9-ae78-f109ce78ec7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.440803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd16333-0a12-41d9-ae78-f109ce78ec7a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.454881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-2cd16333-0a12-41d9-ae78-f109ce78ec7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:40.461092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 425/849] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:40.462376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd16333-0a12-41d9-ae78-f109ce78ec7a None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:40.475137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15cf1-42a4-4277-b762-902f12607370 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:40.513442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b181b43-16c0-46c1-988e-48bb8e69de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.514354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b181b43-16c0-46c1-988e-48bb8e69de56 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.514865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b181b43-16c0-46c1-988e-48bb8e69de56 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.515739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b181b43-16c0-46c1-988e-48bb8e69de56 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.516657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b181b43-16c0-46c1-988e-48bb8e69de56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:40.517237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b181b43-16c0-46c1-988e-48bb8e69de56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.519702 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b181b43-16c0-46c1-988e-48bb8e69de56 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.542151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 425/850] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:40.544921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b181b43-16c0-46c1-988e-48bb8e69de56 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:40.598650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd16333-0a12-41d9-ae78-f109ce78ec7a None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:40.646107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cbbb9-fdb6-4e01-9c75-1f34c49752d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.646792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cbbb9-fdb6-4e01-9c75-1f34c49752d5 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.647074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cbbb9-fdb6-4e01-9c75-1f34c49752d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.647414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cbbb9-fdb6-4e01-9c75-1f34c49752d5 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.648426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cbbb9-fdb6-4e01-9c75-1f34c49752d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:40.648864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cbbb9-fdb6-4e01-9c75-1f34c49752d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.650368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cbbb9-fdb6-4e01-9c75-1f34c49752d5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.670106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 426/851] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:40.673516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cbbb9-fdb6-4e01-9c75-1f34c49752d5 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:40.693214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b181b43-16c0-46c1-988e-48bb8e69de56 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:40.743536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6160585-1d6e-4cb0-9742-95f85d963237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.744732 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6160585-1d6e-4cb0-9742-95f85d963237 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.745208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6160585-1d6e-4cb0-9742-95f85d963237 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.745981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6160585-1d6e-4cb0-9742-95f85d963237 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.756160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6160585-1d6e-4cb0-9742-95f85d963237 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.758247 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6160585-1d6e-4cb0-9742-95f85d963237 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.774289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-e6160585-1d6e-4cb0-9742-95f85d963237 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 22 19:40:40.775679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 426/852] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:40:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:40.777073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5415d8-636b-4b91-9f76-8c69203a4775 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.777434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5415d8-636b-4b91-9f76-8c69203a4775 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.777777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5415d8-636b-4b91-9f76-8c69203a4775 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.779945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 427/853] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:40.781680 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5415d8-636b-4b91-9f76-8c69203a4775 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:40.807140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cbbb9-fdb6-4e01-9c75-1f34c49752d5 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:40.853461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20139f5-f061-402f-86f9-5fa865034ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.854193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20139f5-f061-402f-86f9-5fa865034ac7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.854476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20139f5-f061-402f-86f9-5fa865034ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.854750 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20139f5-f061-402f-86f9-5fa865034ac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.855623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20139f5-f061-402f-86f9-5fa865034ac7 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=439b41be395d4faeae0b855a1e0f25f1) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:40.855916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20139f5-f061-402f-86f9-5fa865034ac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.857388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20139f5-f061-402f-86f9-5fa865034ac7 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.863747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 427/854] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:40 2022] GET /identity/v3/role_assignments?user.id=439b41be395d4faeae0b855a1e0f25f1&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:40.865154 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa6637-8d6d-4d9c-9a0a-d9cc608a88cf None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.865438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa6637-8d6d-4d9c-9a0a-d9cc608a88cf None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.865712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa6637-8d6d-4d9c-9a0a-d9cc608a88cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.884973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-fafa6637-8d6d-4d9c-9a0a-d9cc608a88cf None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:40.886298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-fafa6637-8d6d-4d9c-9a0a-d9cc608a88cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:40.927814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5415d8-636b-4b91-9f76-8c69203a4775 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:40.976800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9168c-c117-43e8-b1b5-28b74e7e0f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:40.978432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9168c-c117-43e8-b1b5-28b74e7e0f3c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:40.978945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9168c-c117-43e8-b1b5-28b74e7e0f3c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:40.979426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9168c-c117-43e8-b1b5-28b74e7e0f3c None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:40.980522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9168c-c117-43e8-b1b5-28b74e7e0f3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:40.981062 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9168c-c117-43e8-b1b5-28b74e7e0f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:40.982852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9168c-c117-43e8-b1b5-28b74e7e0f3c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:40.986849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 428/855] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:41.005684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 428/856] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Mar 22 19:40:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:41.012112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa6637-8d6d-4d9c-9a0a-d9cc608a88cf None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:41.022889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9168c-c117-43e8-b1b5-28b74e7e0f3c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:41.154583 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa6637-8d6d-4d9c-9a0a-d9cc608a88cf None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:41.194777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76339c61-23c3-4751-ad7e-031d8f85ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:41.195489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76339c61-23c3-4751-ad7e-031d8f85ed2c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:41.195770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76339c61-23c3-4751-ad7e-031d8f85ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:41.196044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76339c61-23c3-4751-ad7e-031d8f85ed2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:41.212433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9168c-c117-43e8-b1b5-28b74e7e0f3c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:41.272856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad22ac4-bb30-4630-a68d-959374abcece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:41.274702 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad22ac4-bb30-4630-a68d-959374abcece None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:41.275404 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad22ac4-bb30-4630-a68d-959374abcece None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:41.276093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad22ac4-bb30-4630-a68d-959374abcece None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:41.277528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad22ac4-bb30-4630-a68d-959374abcece None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:41.279767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76339c61-23c3-4751-ad7e-031d8f85ed2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:41.280156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad22ac4-bb30-4630-a68d-959374abcece None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:41.281223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76339c61-23c3-4751-ad7e-031d8f85ed2c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:41.300837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-4ad22ac4-bb30-4630-a68d-959374abcece None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 22 19:40:41.310420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 429/857] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Mar 22 19:40:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:41.312116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbfd87-c0ec-4195-af7b-6bc70ef9948b None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:41.312403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbfd87-c0ec-4195-af7b-6bc70ef9948b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:41.312894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbfd87-c0ec-4195-af7b-6bc70ef9948b None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:41.315298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 430/858] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:41.321167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbfd87-c0ec-4195-af7b-6bc70ef9948b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:41.405301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 429/859] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:40:41.406986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba078c8-3f47-41c2-a8ea-c15074ee3666 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:41.407274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba078c8-3f47-41c2-a8ea-c15074ee3666 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:41.407550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba078c8-3f47-41c2-a8ea-c15074ee3666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:41.427138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-2ba078c8-3f47-41c2-a8ea-c15074ee3666 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:41.428409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2ba078c8-3f47-41c2-a8ea-c15074ee3666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:41.457326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbfd87-c0ec-4195-af7b-6bc70ef9948b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:41.508481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420f709-4de3-40da-9026-612da37dd752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:41.509625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f709-4de3-40da-9026-612da37dd752 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:41.510169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f709-4de3-40da-9026-612da37dd752 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:41.510625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f709-4de3-40da-9026-612da37dd752 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:41.518243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 430/860] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:41.518442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420f709-4de3-40da-9026-612da37dd752 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:41.518442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420f709-4de3-40da-9026-612da37dd752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:41.518635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba078c8-3f47-41c2-a8ea-c15074ee3666 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:41.518719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420f709-4de3-40da-9026-612da37dd752 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:41.533870 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 431/861] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:41.540015 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420f709-4de3-40da-9026-612da37dd752 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:41.637561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba078c8-3f47-41c2-a8ea-c15074ee3666 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:41.666467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420f709-4de3-40da-9026-612da37dd752 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:41.680301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e6d16-9474-4945-a998-587f8bc8007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:41.681115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e6d16-9474-4945-a998-587f8bc8007e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:41.681387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e6d16-9474-4945-a998-587f8bc8007e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:41.681669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e6d16-9474-4945-a998-587f8bc8007e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:41.695020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e6d16-9474-4945-a998-587f8bc8007e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:41.697710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e6d16-9474-4945-a998-587f8bc8007e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:41.712476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cc23e-8721-4b50-b872-ba077cbb9e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:41.713282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cc23e-8721-4b50-b872-ba077cbb9e90 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:41.713586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cc23e-8721-4b50-b872-ba077cbb9e90 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:41.713839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cc23e-8721-4b50-b872-ba077cbb9e90 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:41.714576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cc23e-8721-4b50-b872-ba077cbb9e90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:41.714887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cc23e-8721-4b50-b872-ba077cbb9e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:41.716290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cc23e-8721-4b50-b872-ba077cbb9e90 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:41.729484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 432/862] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:41 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:41.729484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cc23e-8721-4b50-b872-ba077cbb9e90 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:41.729842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a68e6d16-9474-4945-a998-587f8bc8007e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:41.732922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 431/863] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:41.739717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e6d16-9474-4945-a998-587f8bc8007e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:41.877988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cc23e-8721-4b50-b872-ba077cbb9e90 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:41.919815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e6d16-9474-4945-a998-587f8bc8007e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:41.926677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f13103-4c0e-405d-bc92-539555dae3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:41.927640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f13103-4c0e-405d-bc92-539555dae3ea None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:41.927978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f13103-4c0e-405d-bc92-539555dae3ea None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:41.928304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f13103-4c0e-405d-bc92-539555dae3ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:41.930440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f13103-4c0e-405d-bc92-539555dae3ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:41.933265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f13103-4c0e-405d-bc92-539555dae3ea None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:41.951060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-55f13103-4c0e-405d-bc92-539555dae3ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 22 19:40:41.953907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 433/864] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:40:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:41.961350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f13103-4c0e-405d-bc92-539555dae3ea None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:41.975231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e690f39-4648-4334-979e-d2721294cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:41.976530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e690f39-4648-4334-979e-d2721294cf2c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:41.977085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e690f39-4648-4334-979e-d2721294cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:41.977732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e690f39-4648-4334-979e-d2721294cf2c None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:41.979039 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e690f39-4648-4334-979e-d2721294cf2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:41.979913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e690f39-4648-4334-979e-d2721294cf2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:41.982965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e690f39-4648-4334-979e-d2721294cf2c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:42.007543 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 432/865] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:42.015161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e690f39-4648-4334-979e-d2721294cf2c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:42.157298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f13103-4c0e-405d-bc92-539555dae3ea None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:42.169712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e690f39-4648-4334-979e-d2721294cf2c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:42.221589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612837f-506f-4f6e-ab5d-894b80292101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:42.223628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612837f-506f-4f6e-ab5d-894b80292101 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:42.224407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612837f-506f-4f6e-ab5d-894b80292101 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:42.225213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612837f-506f-4f6e-ab5d-894b80292101 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:42.227568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612837f-506f-4f6e-ab5d-894b80292101 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:42.228013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612837f-506f-4f6e-ab5d-894b80292101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:42.229749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612837f-506f-4f6e-ab5d-894b80292101 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:42.244223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4effcef-f21e-4795-a1e9-13df9c6c03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:42.245267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4effcef-f21e-4795-a1e9-13df9c6c03c3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:42.245594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4effcef-f21e-4795-a1e9-13df9c6c03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:42.245873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4effcef-f21e-4795-a1e9-13df9c6c03c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:42.254041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 434/866] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:40:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:42.257516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4effcef-f21e-4795-a1e9-13df9c6c03c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:42.258869 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612837f-506f-4f6e-ab5d-894b80292101 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:42.259211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4effcef-f21e-4795-a1e9-13df9c6c03c3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:42.280204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-c4effcef-f21e-4795-a1e9-13df9c6c03c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:42.290225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 433/867] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:42.292227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4effcef-f21e-4795-a1e9-13df9c6c03c3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:42.404149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612837f-506f-4f6e-ab5d-894b80292101 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:42.452559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4effcef-f21e-4795-a1e9-13df9c6c03c3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:42.471555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9f4f-081b-48c1-b308-fb37f6036fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:42.473676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9f4f-081b-48c1-b308-fb37f6036fb3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:42.474578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9f4f-081b-48c1-b308-fb37f6036fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:42.475443 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9f4f-081b-48c1-b308-fb37f6036fb3 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:42.477248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9f4f-081b-48c1-b308-fb37f6036fb3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:42.478261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9f4f-081b-48c1-b308-fb37f6036fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:42.481381 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9f4f-081b-48c1-b308-fb37f6036fb3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:42.498075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 435/868] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:40:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:42.502345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4f90c-5f7e-407c-a252-0834b254f2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:42.503092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4f90c-5f7e-407c-a252-0834b254f2ba None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:42.503381 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4f90c-5f7e-407c-a252-0834b254f2ba None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:42.503659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4f90c-5f7e-407c-a252-0834b254f2ba None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:42.504519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4f90c-5f7e-407c-a252-0834b254f2ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:42.504855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4f90c-5f7e-407c-a252-0834b254f2ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:42.506515 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4f90c-5f7e-407c-a252-0834b254f2ba None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:42.523064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 434/869] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:42.529875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9f4f-081b-48c1-b308-fb37f6036fb3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:42.686070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9f4f-081b-48c1-b308-fb37f6036fb3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:42.751978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55106d77-6b49-4fc7-b266-f17f37516234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:42.752853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55106d77-6b49-4fc7-b266-f17f37516234 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:42.753303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55106d77-6b49-4fc7-b266-f17f37516234 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:42.753756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55106d77-6b49-4fc7-b266-f17f37516234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:42.754882 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55106d77-6b49-4fc7-b266-f17f37516234 None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=d526f13b514045ec9ebee14edf3fe79f) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:42.755396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55106d77-6b49-4fc7-b266-f17f37516234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:42.757307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55106d77-6b49-4fc7-b266-f17f37516234 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:42.767256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 436/870] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:42 2022] GET /identity/v3/role_assignments?user.id=d526f13b514045ec9ebee14edf3fe79f&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:43.360864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c336-c275-41bb-add7-f85c88d48512 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:43.361715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c336-c275-41bb-add7-f85c88d48512 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:43.361715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c336-c275-41bb-add7-f85c88d48512 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:43.363428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 435/871] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:43.369555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e884c-7d9b-4b20-9760-738fb6446b40 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:43.370289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e884c-7d9b-4b20-9760-738fb6446b40 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:43.370289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e884c-7d9b-4b20-9760-738fb6446b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:43.387511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-8c2e884c-7d9b-4b20-9760-738fb6446b40 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:43.388687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-8c2e884c-7d9b-4b20-9760-738fb6446b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:43.458849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 437/872] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:43.481531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5c336-c275-41bb-add7-f85c88d48512 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:43.587690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5c336-c275-41bb-add7-f85c88d48512 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:43.628344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a85fd5-ec57-4afb-ac13-484e81a48f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:43.629053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a85fd5-ec57-4afb-ac13-484e81a48f78 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:43.629329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a85fd5-ec57-4afb-ac13-484e81a48f78 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:43.629599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a85fd5-ec57-4afb-ac13-484e81a48f78 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:43.630343 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a85fd5-ec57-4afb-ac13-484e81a48f78 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:43.631969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a85fd5-ec57-4afb-ac13-484e81a48f78 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:43.643920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-d9a85fd5-ec57-4afb-ac13-484e81a48f78 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 22 19:40:43.645648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 436/873] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:43.652695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e884c-7d9b-4b20-9760-738fb6446b40 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:43.755683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e884c-7d9b-4b20-9760-738fb6446b40 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:43.790690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6550d6-7c5c-4644-ad92-aa24f381ed2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:43.791380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6550d6-7c5c-4644-ad92-aa24f381ed2e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:43.791660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6550d6-7c5c-4644-ad92-aa24f381ed2e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:43.791927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6550d6-7c5c-4644-ad92-aa24f381ed2e None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:43.792655 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6550d6-7c5c-4644-ad92-aa24f381ed2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:43.792964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6550d6-7c5c-4644-ad92-aa24f381ed2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:43.794462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6550d6-7c5c-4644-ad92-aa24f381ed2e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:43.800337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 438/874] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:40:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:43.806410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a85fd5-ec57-4afb-ac13-484e81a48f78 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:43.924300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a85fd5-ec57-4afb-ac13-484e81a48f78 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:43.962019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a29dc-9034-4aee-b5cf-21e066bd1490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:43.963071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a29dc-9034-4aee-b5cf-21e066bd1490 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:43.963544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a29dc-9034-4aee-b5cf-21e066bd1490 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:43.964031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a29dc-9034-4aee-b5cf-21e066bd1490 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:43.964965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a29dc-9034-4aee-b5cf-21e066bd1490 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:43.965462 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a29dc-9034-4aee-b5cf-21e066bd1490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:43.967157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a29dc-9034-4aee-b5cf-21e066bd1490 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:43.972941 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 437/875] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:40:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:44.728219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dd8ef-9647-4f8c-bfc8-69df331a97ff None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:44.728766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dd8ef-9647-4f8c-bfc8-69df331a97ff None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:44.728766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dd8ef-9647-4f8c-bfc8-69df331a97ff None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:44.731123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 439/876] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:44.737226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ff60-c0d2-4176-9746-3aacd3b62d56 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:44.738274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ff60-c0d2-4176-9746-3aacd3b62d56 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:44.738765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ff60-c0d2-4176-9746-3aacd3b62d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:44.757851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-7456ff60-c0d2-4176-9746-3aacd3b62d56 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:44.759468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7456ff60-c0d2-4176-9746-3aacd3b62d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:44.830366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 438/877] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:44.853106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dd8ef-9647-4f8c-bfc8-69df331a97ff None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:44.965231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dd8ef-9647-4f8c-bfc8-69df331a97ff None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:45.002564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dd98d-4d19-42ad-b55e-7d815cfb26f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:45.003576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dd98d-4d19-42ad-b55e-7d815cfb26f2 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:45.004156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dd98d-4d19-42ad-b55e-7d815cfb26f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:45.004623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dd98d-4d19-42ad-b55e-7d815cfb26f2 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:45.005544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dd98d-4d19-42ad-b55e-7d815cfb26f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:45.007289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dd98d-4d19-42ad-b55e-7d815cfb26f2 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:45.024558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 440/878] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:40:44 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:40:45.099362 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777529b-92fd-46b4-bee3-af3fa0e8a00b None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:45.099702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777529b-92fd-46b4-bee3-af3fa0e8a00b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:45.099922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777529b-92fd-46b4-bee3-af3fa0e8a00b None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:45.102510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 439/879] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:45.108558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ca7d-282f-4556-a2f4-6bd7cb1b6eca None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:45.108869 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ca7d-282f-4556-a2f4-6bd7cb1b6eca None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:45.109138 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ca7d-282f-4556-a2f4-6bd7cb1b6eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:45.130634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7f77ca7d-282f-4556-a2f4-6bd7cb1b6eca None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:45.132162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7f77ca7d-282f-4556-a2f4-6bd7cb1b6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:45.217321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 441/880] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:45 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:45.241204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777529b-92fd-46b4-bee3-af3fa0e8a00b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:45.327965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b645e-7280-420c-bbd9-22f66de27635 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:45.328358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b645e-7280-420c-bbd9-22f66de27635 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:45.328643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b645e-7280-420c-bbd9-22f66de27635 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:45.331023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 442/881] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:40:45.337033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d25d9d-a43e-4a2d-90d8-1ca8809cdc24 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:45.337337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d25d9d-a43e-4a2d-90d8-1ca8809cdc24 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:45.337582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d25d9d-a43e-4a2d-90d8-1ca8809cdc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:45.359534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-86d25d9d-a43e-4a2d-90d8-1ca8809cdc24 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:45.360303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777529b-92fd-46b4-bee3-af3fa0e8a00b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:45.360784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-86d25d9d-a43e-4a2d-90d8-1ca8809cdc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:45.400709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d0ad-a9a8-4ff7-ae5b-971a3ce00a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:45.401591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d0ad-a9a8-4ff7-ae5b-971a3ce00a91 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:45.401874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d0ad-a9a8-4ff7-ae5b-971a3ce00a91 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:45.402185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d0ad-a9a8-4ff7-ae5b-971a3ce00a91 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:45.402949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0d0ad-a9a8-4ff7-ae5b-971a3ce00a91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:45.404372 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0d0ad-a9a8-4ff7-ae5b-971a3ce00a91 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:45.423757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 440/882] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:40:45 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:40:45.458916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 443/883] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:40:45.485321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d0ad-a9a8-4ff7-ae5b-971a3ce00a91 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:45.646013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d0ad-a9a8-4ff7-ae5b-971a3ce00a91 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:45.691243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de165a5a-61f1-4143-8a32-12cd812358d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:45.692079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de165a5a-61f1-4143-8a32-12cd812358d2 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:45.692357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de165a5a-61f1-4143-8a32-12cd812358d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:45.692631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de165a5a-61f1-4143-8a32-12cd812358d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:45.704209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de165a5a-61f1-4143-8a32-12cd812358d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:45.711976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-de165a5a-61f1-4143-8a32-12cd812358d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 22 19:40:45.713567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 441/884] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Mar 22 19:40:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:45.719608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d25d9d-a43e-4a2d-90d8-1ca8809cdc24 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:45.823779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d25d9d-a43e-4a2d-90d8-1ca8809cdc24 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:45.885593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5b3f-c10d-4f91-bfff-e08da60b7a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:45.886721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5b3f-c10d-4f91-bfff-e08da60b7a08 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:45.887204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5b3f-c10d-4f91-bfff-e08da60b7a08 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:45.887673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c5b3f-c10d-4f91-bfff-e08da60b7a08 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:45.888650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c5b3f-c10d-4f91-bfff-e08da60b7a08 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:45.889199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c5b3f-c10d-4f91-bfff-e08da60b7a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:45.890840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c5b3f-c10d-4f91-bfff-e08da60b7a08 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:45.900720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 444/885] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Mar 22 19:40:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:45.906658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de165a5a-61f1-4143-8a32-12cd812358d2 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:46.024427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de165a5a-61f1-4143-8a32-12cd812358d2 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:46.064433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c7ddb-ad82-4c7d-ad2b-081a78929d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:46.065638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c7ddb-ad82-4c7d-ad2b-081a78929d93 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:46.066156 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c7ddb-ad82-4c7d-ad2b-081a78929d93 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:46.066631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c7ddb-ad82-4c7d-ad2b-081a78929d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:46.078660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c7ddb-ad82-4c7d-ad2b-081a78929d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:46.080521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c7ddb-ad82-4c7d-ad2b-081a78929d93 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:46.100088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-1f9c7ddb-ad82-4c7d-ad2b-081a78929d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:46.102299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 442/886] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:46.109054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5b3f-c10d-4f91-bfff-e08da60b7a08 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:46.266642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c5b3f-c10d-4f91-bfff-e08da60b7a08 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:46.317590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dcad7-142b-416b-8cbf-48d6055e5f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:46.318951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dcad7-142b-416b-8cbf-48d6055e5f19 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:46.319568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dcad7-142b-416b-8cbf-48d6055e5f19 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:46.320282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dcad7-142b-416b-8cbf-48d6055e5f19 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:46.321396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dcad7-142b-416b-8cbf-48d6055e5f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:46.322184 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dcad7-142b-416b-8cbf-48d6055e5f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:46.324313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dcad7-142b-416b-8cbf-48d6055e5f19 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:46.346443 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 445/887] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:46.352217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c7ddb-ad82-4c7d-ad2b-081a78929d93 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:46.473829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c7ddb-ad82-4c7d-ad2b-081a78929d93 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:46.509376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c2c5-c4d6-4781-8b89-e0da2b88e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:46.510233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c2c5-c4d6-4781-8b89-e0da2b88e795 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:46.510509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c2c5-c4d6-4781-8b89-e0da2b88e795 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:46.510775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c2c5-c4d6-4781-8b89-e0da2b88e795 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:46.519261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950c2c5-c4d6-4781-8b89-e0da2b88e795 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:46.520613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950c2c5-c4d6-4781-8b89-e0da2b88e795 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:46.535754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-c950c2c5-c4d6-4781-8b89-e0da2b88e795 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 22 19:40:46.537345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 443/888] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:40:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:46.545327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dcad7-142b-416b-8cbf-48d6055e5f19 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:46.731978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dcad7-142b-416b-8cbf-48d6055e5f19 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:46.743044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aa69d-598c-4883-abe5-352d04626d86 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:46.743330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aa69d-598c-4883-abe5-352d04626d86 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:46.743654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aa69d-598c-4883-abe5-352d04626d86 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:46.745706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 444/889] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:40:46.751320 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8fa49-0970-4384-b27b-58f4815c05b5 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:46.751594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8fa49-0970-4384-b27b-58f4815c05b5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:46.751919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8fa49-0970-4384-b27b-58f4815c05b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:46.776524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-48c8fa49-0970-4384-b27b-58f4815c05b5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:46.777809 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-48c8fa49-0970-4384-b27b-58f4815c05b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:46.797211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecf515-9fe3-4fcc-8331-ce3aa3f7c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:46.798679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecf515-9fe3-4fcc-8331-ce3aa3f7c36d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:46.799644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecf515-9fe3-4fcc-8331-ce3aa3f7c36d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:46.800151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecf515-9fe3-4fcc-8331-ce3aa3f7c36d None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:46.801789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecf515-9fe3-4fcc-8331-ce3aa3f7c36d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:46.803067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecf515-9fe3-4fcc-8331-ce3aa3f7c36d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:46.807096 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecf515-9fe3-4fcc-8331-ce3aa3f7c36d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:46.849831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 446/890] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Mar 22 19:40:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:46.856673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecf515-9fe3-4fcc-8331-ce3aa3f7c36d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:46.890060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 445/891] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:40:46.913776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8fa49-0970-4384-b27b-58f4815c05b5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:46.987329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecf515-9fe3-4fcc-8331-ce3aa3f7c36d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:47.027072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4499f3-7a46-4c75-aebc-8626ee387762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:47.028102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4499f3-7a46-4c75-aebc-8626ee387762 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:47.028557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4499f3-7a46-4c75-aebc-8626ee387762 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:47.029019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4499f3-7a46-4c75-aebc-8626ee387762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:47.053834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8fa49-0970-4384-b27b-58f4815c05b5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:47.092048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f43b2-2c90-4bdc-bf47-e11fb516f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:47.093109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f43b2-2c90-4bdc-bf47-e11fb516f8f5 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:47.093570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f43b2-2c90-4bdc-bf47-e11fb516f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:47.094067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f43b2-2c90-4bdc-bf47-e11fb516f8f5 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:47.095013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f43b2-2c90-4bdc-bf47-e11fb516f8f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:47.096628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f43b2-2c90-4bdc-bf47-e11fb516f8f5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:47.116181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 446/892] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:40:46 2022] POST /identity/v3/services => generated 241 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:40:47.128632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4499f3-7a46-4c75-aebc-8626ee387762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:47.134044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4499f3-7a46-4c75-aebc-8626ee387762 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:47.262307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 447/893] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:46 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:40:47.271283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f43b2-2c90-4bdc-bf47-e11fb516f8f5 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:47.437328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f43b2-2c90-4bdc-bf47-e11fb516f8f5 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:47.495519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc645b5-9307-4371-8332-005b778c6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:47.496909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc645b5-9307-4371-8332-005b778c6646 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:47.497369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc645b5-9307-4371-8332-005b778c6646 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:47.497858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc645b5-9307-4371-8332-005b778c6646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:47.517318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc645b5-9307-4371-8332-005b778c6646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:47.517775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789ec7f-0ea8-4237-9751-353bbd02485a None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:47.518352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789ec7f-0ea8-4237-9751-353bbd02485a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:47.518844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789ec7f-0ea8-4237-9751-353bbd02485a None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:47.519983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc645b5-9307-4371-8332-005b778c6646 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:47.521592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 448/894] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:40:47.527969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62ef8-13a4-4bf7-9e87-284fe541ea91 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:47.528603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62ef8-13a4-4bf7-9e87-284fe541ea91 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:47.529085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62ef8-13a4-4bf7-9e87-284fe541ea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:47.548587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fff62ef8-13a4-4bf7-9e87-284fe541ea91 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:47.550775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fff62ef8-13a4-4bf7-9e87-284fe541ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:47.552520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-0fc645b5-9307-4371-8332-005b778c6646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:47.554218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 447/895] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:47.560472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc645b5-9307-4371-8332-005b778c6646 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:47.632237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 449/896] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:40:47.656177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62ef8-13a4-4bf7-9e87-284fe541ea91 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:47.663411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc645b5-9307-4371-8332-005b778c6646 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:47.700479 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc938e-d666-427a-9778-4e5c95ad882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:47.701062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc938e-d666-427a-9778-4e5c95ad882e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:47.701493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc938e-d666-427a-9778-4e5c95ad882e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:47.701904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc938e-d666-427a-9778-4e5c95ad882e None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:47.702787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc938e-d666-427a-9778-4e5c95ad882e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:47.703261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc938e-d666-427a-9778-4e5c95ad882e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:47.704788 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc938e-d666-427a-9778-4e5c95ad882e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:47.717546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 448/897] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:47.723619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc938e-d666-427a-9778-4e5c95ad882e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:47.780091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62ef8-13a4-4bf7-9e87-284fe541ea91 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:47.853754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ef058-b9b2-412c-b46a-bebee74beb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:47.854758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ef058-b9b2-412c-b46a-bebee74beb2c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:47.855255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ef058-b9b2-412c-b46a-bebee74beb2c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:47.855757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ef058-b9b2-412c-b46a-bebee74beb2c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:47.856744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ef058-b9b2-412c-b46a-bebee74beb2c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:47.858891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ef058-b9b2-412c-b46a-bebee74beb2c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:47.866104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc938e-d666-427a-9778-4e5c95ad882e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:47.876529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-5a9ef058-b9b2-412c-b46a-bebee74beb2c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 22 19:40:47.879335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 450/898] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Mar 22 19:40:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:47.889438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ef058-b9b2-412c-b46a-bebee74beb2c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:47.934026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e826a-5f59-4633-ae48-f71173482519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:47.935483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e826a-5f59-4633-ae48-f71173482519 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:47.935911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e826a-5f59-4633-ae48-f71173482519 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:47.936327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e826a-5f59-4633-ae48-f71173482519 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:47.949240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e826a-5f59-4633-ae48-f71173482519 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:47.951412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e826a-5f59-4633-ae48-f71173482519 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:47.994579 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-e01e826a-5f59-4633-ae48-f71173482519 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:47.998610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 449/899] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:48.009983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e826a-5f59-4633-ae48-f71173482519 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:48.015840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ef058-b9b2-412c-b46a-bebee74beb2c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:48.054651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1bacf-67fc-4384-bf2f-213a57de5f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:48.055726 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1bacf-67fc-4384-bf2f-213a57de5f68 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:48.056192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1bacf-67fc-4384-bf2f-213a57de5f68 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:48.056607 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1bacf-67fc-4384-bf2f-213a57de5f68 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:48.057639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1bacf-67fc-4384-bf2f-213a57de5f68 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:48.058273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1bacf-67fc-4384-bf2f-213a57de5f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:48.060145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1bacf-67fc-4384-bf2f-213a57de5f68 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:48.066874 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 451/900] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:48.077562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1bacf-67fc-4384-bf2f-213a57de5f68 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:48.129967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e826a-5f59-4633-ae48-f71173482519 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:48.168412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e97e6-eebf-4897-8a64-b78ed67b9686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:48.169096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e97e6-eebf-4897-8a64-b78ed67b9686 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:48.169378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e97e6-eebf-4897-8a64-b78ed67b9686 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:48.169657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e97e6-eebf-4897-8a64-b78ed67b9686 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:48.171128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e97e6-eebf-4897-8a64-b78ed67b9686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:48.171450 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e97e6-eebf-4897-8a64-b78ed67b9686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:48.173283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e97e6-eebf-4897-8a64-b78ed67b9686 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:48.188905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 450/901] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:48.195404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e97e6-eebf-4897-8a64-b78ed67b9686 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:48.232843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1bacf-67fc-4384-bf2f-213a57de5f68 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:48.275251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807cb09-b0a0-452a-9a3d-4ce30bd77899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:48.276386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807cb09-b0a0-452a-9a3d-4ce30bd77899 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:48.276898 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807cb09-b0a0-452a-9a3d-4ce30bd77899 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:48.277384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807cb09-b0a0-452a-9a3d-4ce30bd77899 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:48.278412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807cb09-b0a0-452a-9a3d-4ce30bd77899 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:48.278960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807cb09-b0a0-452a-9a3d-4ce30bd77899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:48.280619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807cb09-b0a0-452a-9a3d-4ce30bd77899 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:48.286801 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 452/902] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:48.294215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807cb09-b0a0-452a-9a3d-4ce30bd77899 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:48.319931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e97e6-eebf-4897-8a64-b78ed67b9686 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:48.359458 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e1890-e550-4cf8-8e6a-948ad299ece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:48.360545 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e1890-e550-4cf8-8e6a-948ad299ece1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:48.361033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e1890-e550-4cf8-8e6a-948ad299ece1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:48.361512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e1890-e550-4cf8-8e6a-948ad299ece1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:48.362615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e1890-e550-4cf8-8e6a-948ad299ece1 None admin] RBAC: Adding query filter params (role.id=0b1f8a3d96c0431588550996691555d2, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=d526f13b514045ec9ebee14edf3fe79f) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:48.363146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e1890-e550-4cf8-8e6a-948ad299ece1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:48.364821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e1890-e550-4cf8-8e6a-948ad299ece1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:48.378097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 451/903] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:48 2022] GET /identity/v3/role_assignments?user.id=d526f13b514045ec9ebee14edf3fe79f&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=0b1f8a3d96c0431588550996691555d2 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:48.411353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807cb09-b0a0-452a-9a3d-4ce30bd77899 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:48.468080 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b8d6f-137f-43ae-b09a-271b1b1839c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:48.469382 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b8d6f-137f-43ae-b09a-271b1b1839c4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:48.469880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b8d6f-137f-43ae-b09a-271b1b1839c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:48.470416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b8d6f-137f-43ae-b09a-271b1b1839c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:48.471985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b8d6f-137f-43ae-b09a-271b1b1839c4 None admin] RBAC: Adding query filter params (interface=public, service_id=cee69aa4c6144d31a7921da5fe2a5dbb, region_id=RegionOne) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:48.472530 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b8d6f-137f-43ae-b09a-271b1b1839c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:48.475676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b8d6f-137f-43ae-b09a-271b1b1839c4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:48.491163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 453/904] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Mar 22 19:40:48 2022] GET /identity/v3/endpoints?service_id=cee69aa4c6144d31a7921da5fe2a5dbb&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:48.498706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e1890-e550-4cf8-8e6a-948ad299ece1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:48.685073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e1890-e550-4cf8-8e6a-948ad299ece1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:48.689930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe51c8b-aa5e-4e25-b83e-69f91f4a138d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:48.690253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe51c8b-aa5e-4e25-b83e-69f91f4a138d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:48.690523 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe51c8b-aa5e-4e25-b83e-69f91f4a138d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:48.692949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 454/905] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:40:48.699854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c865-0b9b-44f1-84a8-f08422ef6c92 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:48.700181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c865-0b9b-44f1-84a8-f08422ef6c92 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:48.700581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c865-0b9b-44f1-84a8-f08422ef6c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:48.727803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-17b7c865-0b9b-44f1-84a8-f08422ef6c92 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:48.729386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-17b7c865-0b9b-44f1-84a8-f08422ef6c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:48.737896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22989119-8ae2-45d4-bec2-1c78a8320e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:48.739145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22989119-8ae2-45d4-bec2-1c78a8320e27 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:48.739633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22989119-8ae2-45d4-bec2-1c78a8320e27 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:48.740120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22989119-8ae2-45d4-bec2-1c78a8320e27 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:48.742157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22989119-8ae2-45d4-bec2-1c78a8320e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:48.745096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22989119-8ae2-45d4-bec2-1c78a8320e27 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:48.757105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 452/906] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Mar 22 19:40:48 2022] GET /identity/v3/services => generated 1497 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:40:48.849695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 455/907] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:40:48.892878 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22989119-8ae2-45d4-bec2-1c78a8320e27 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:49.035136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22989119-8ae2-45d4-bec2-1c78a8320e27 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:49.075923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e9b9-920e-4454-b793-1ce4690dc8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:49.077048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e9b9-920e-4454-b793-1ce4690dc8a7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:49.077491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e9b9-920e-4454-b793-1ce4690dc8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:49.077921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e9b9-920e-4454-b793-1ce4690dc8a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:49.078804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275e9b9-920e-4454-b793-1ce4690dc8a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:49.080418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275e9b9-920e-4454-b793-1ce4690dc8a7 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:49.093229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-7275e9b9-920e-4454-b793-1ce4690dc8a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 22 19:40:49.095126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 453/908] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:40:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:49.103158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c865-0b9b-44f1-84a8-f08422ef6c92 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:49.229117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c865-0b9b-44f1-84a8-f08422ef6c92 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:49.270726 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fb86b-a144-4e7c-9cfa-a26a0b106c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:49.271440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb86b-a144-4e7c-9cfa-a26a0b106c14 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:49.271721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb86b-a144-4e7c-9cfa-a26a0b106c14 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:49.271989 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb86b-a144-4e7c-9cfa-a26a0b106c14 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:49.273700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb86b-a144-4e7c-9cfa-a26a0b106c14 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:49.274034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb86b-a144-4e7c-9cfa-a26a0b106c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:49.275505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb86b-a144-4e7c-9cfa-a26a0b106c14 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:49.281633 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 456/909] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:40:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:49.287718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e9b9-920e-4454-b793-1ce4690dc8a7 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:49.403118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e9b9-920e-4454-b793-1ce4690dc8a7 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:49.439231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23aa94-166f-4d8c-b194-75a3320683fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:49.440316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23aa94-166f-4d8c-b194-75a3320683fe None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:49.440797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23aa94-166f-4d8c-b194-75a3320683fe None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:49.441275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23aa94-166f-4d8c-b194-75a3320683fe None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:49.442233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23aa94-166f-4d8c-b194-75a3320683fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:49.442766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23aa94-166f-4d8c-b194-75a3320683fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:49.444500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23aa94-166f-4d8c-b194-75a3320683fe None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:49.450812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 454/910] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:40:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:49.459739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fb86b-a144-4e7c-9cfa-a26a0b106c14 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:49.565971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fb86b-a144-4e7c-9cfa-a26a0b106c14 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:49.603563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58515ca-ee9a-4993-972c-ab435e464c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:49.604512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58515ca-ee9a-4993-972c-ab435e464c61 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:49.604942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58515ca-ee9a-4993-972c-ab435e464c61 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:49.605356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58515ca-ee9a-4993-972c-ab435e464c61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:49.606325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58515ca-ee9a-4993-972c-ab435e464c61 None admin] RBAC: Adding query filter params (interface=public, service_id=4025c2e6e3ac45619dbab84b6a61e756, region_id=RegionOne) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:49.606793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58515ca-ee9a-4993-972c-ab435e464c61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:49.608319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58515ca-ee9a-4993-972c-ab435e464c61 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:49.614553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 457/911] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Mar 22 19:40:49 2022] GET /identity/v3/endpoints?service_id=4025c2e6e3ac45619dbab84b6a61e756&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:49.624643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23aa94-166f-4d8c-b194-75a3320683fe None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:49.732757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685945a-9921-4c29-a618-aaf77f683fd6 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:49.733473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685945a-9921-4c29-a618-aaf77f683fd6 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:49.733991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685945a-9921-4c29-a618-aaf77f683fd6 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:49.734225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23aa94-166f-4d8c-b194-75a3320683fe None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:49.737872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 458/912] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:49.742756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786de65-9c4b-4023-b566-def64cb927a2 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:49.743096 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786de65-9c4b-4023-b566-def64cb927a2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:49.743311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786de65-9c4b-4023-b566-def64cb927a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:49.765396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-0786de65-9c4b-4023-b566-def64cb927a2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:49.767333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0786de65-9c4b-4023-b566-def64cb927a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:49.776253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea7a9a-ee16-4cd1-86bb-b6eaa8bf8f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:49.777388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea7a9a-ee16-4cd1-86bb-b6eaa8bf8f4f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:49.777675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea7a9a-ee16-4cd1-86bb-b6eaa8bf8f4f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:49.777986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea7a9a-ee16-4cd1-86bb-b6eaa8bf8f4f None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:49.778782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea7a9a-ee16-4cd1-86bb-b6eaa8bf8f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:49.780298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea7a9a-ee16-4cd1-86bb-b6eaa8bf8f4f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:49.787430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 455/913] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Mar 22 19:40:49 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:40:49.856064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 459/914] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:49.880316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea7a9a-ee16-4cd1-86bb-b6eaa8bf8f4f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:50.051565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea7a9a-ee16-4cd1-86bb-b6eaa8bf8f4f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:50.088834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11215d1-f1cc-4ffc-9c0d-e0cdd33f1447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:50.089699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11215d1-f1cc-4ffc-9c0d-e0cdd33f1447 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:50.090110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11215d1-f1cc-4ffc-9c0d-e0cdd33f1447 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:50.090551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11215d1-f1cc-4ffc-9c0d-e0cdd33f1447 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:50.091488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11215d1-f1cc-4ffc-9c0d-e0cdd33f1447 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:50.092906 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11215d1-f1cc-4ffc-9c0d-e0cdd33f1447 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:50.106578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a11215d1-f1cc-4ffc-9c0d-e0cdd33f1447 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 22 19:40:50.108478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 456/915] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:50.118066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786de65-9c4b-4023-b566-def64cb927a2 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:50.294499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786de65-9c4b-4023-b566-def64cb927a2 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:50.348808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee48d-4e17-4102-94cf-c7d2ee5871b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:50.349850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee48d-4e17-4102-94cf-c7d2ee5871b8 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:50.351081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee48d-4e17-4102-94cf-c7d2ee5871b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:50.351596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee48d-4e17-4102-94cf-c7d2ee5871b8 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:50.352981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee48d-4e17-4102-94cf-c7d2ee5871b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:50.353549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee48d-4e17-4102-94cf-c7d2ee5871b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:50.356293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee48d-4e17-4102-94cf-c7d2ee5871b8 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:50.368008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 460/916] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:40:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:50.377312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11215d1-f1cc-4ffc-9c0d-e0cdd33f1447 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:50.490667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11215d1-f1cc-4ffc-9c0d-e0cdd33f1447 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:50.536150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4711dfa-94a4-4628-968c-b93812cb8072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:50.536825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4711dfa-94a4-4628-968c-b93812cb8072 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:50.537103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4711dfa-94a4-4628-968c-b93812cb8072 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:50.537371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4711dfa-94a4-4628-968c-b93812cb8072 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:50.538812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4711dfa-94a4-4628-968c-b93812cb8072 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:50.539123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4711dfa-94a4-4628-968c-b93812cb8072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:50.540522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4711dfa-94a4-4628-968c-b93812cb8072 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:50.546566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 457/917] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:40:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:50.555700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee48d-4e17-4102-94cf-c7d2ee5871b8 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:50.726478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee48d-4e17-4102-94cf-c7d2ee5871b8 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:50.785547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3840c-73c2-464e-a041-bdd6641d65c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:50.787172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3840c-73c2-464e-a041-bdd6641d65c2 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:50.787931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3840c-73c2-464e-a041-bdd6641d65c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:50.788708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3840c-73c2-464e-a041-bdd6641d65c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:50.790255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3840c-73c2-464e-a041-bdd6641d65c2 None admin] RBAC: Adding query filter params (interface=public, service_id=0cc086cf932e48c8b5d98a8d22c0718d, region_id=RegionOne) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:50.791114 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3840c-73c2-464e-a041-bdd6641d65c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:50.794128 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3840c-73c2-464e-a041-bdd6641d65c2 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:50.804234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 461/918] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Mar 22 19:40:50 2022] GET /identity/v3/endpoints?service_id=0cc086cf932e48c8b5d98a8d22c0718d&interface=public®ion_id=RegionOne => generated 194 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:50.813589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4711dfa-94a4-4628-968c-b93812cb8072 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:50.948000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4711dfa-94a4-4628-968c-b93812cb8072 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:50.985343 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c4cff-b995-4699-a325-6eea3185acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:50.985907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c4cff-b995-4699-a325-6eea3185acc8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:50.986213 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c4cff-b995-4699-a325-6eea3185acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:50.986484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c4cff-b995-4699-a325-6eea3185acc8 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:50.987165 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c4cff-b995-4699-a325-6eea3185acc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:50.988539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c4cff-b995-4699-a325-6eea3185acc8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:50.995927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 458/919] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Mar 22 19:40:50 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:40:51.405003 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0324-149b-4bca-94ae-6d3b9f4f5de8 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:51.406100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0324-149b-4bca-94ae-6d3b9f4f5de8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:51.406604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0324-149b-4bca-94ae-6d3b9f4f5de8 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:51.409019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 462/920] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:51.415458 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e91a5-cde9-49e7-a23f-760288f85085 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:51.416370 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e91a5-cde9-49e7-a23f-760288f85085 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:51.416841 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e91a5-cde9-49e7-a23f-760288f85085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:51.435946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-083e91a5-cde9-49e7-a23f-760288f85085 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:51.437478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-083e91a5-cde9-49e7-a23f-760288f85085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:51.513539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 459/921] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:51.533625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0324-149b-4bca-94ae-6d3b9f4f5de8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:51.631054 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20db885-c201-4584-9da5-a5e563184231 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:51.631967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20db885-c201-4584-9da5-a5e563184231 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:51.632709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20db885-c201-4584-9da5-a5e563184231 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:51.635154 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 460/922] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:51.647892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630458c-0d24-4320-a376-ae4e7bf7b5f0 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:51.648763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630458c-0d24-4320-a376-ae4e7bf7b5f0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:51.649613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630458c-0d24-4320-a376-ae4e7bf7b5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:51.655884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0324-149b-4bca-94ae-6d3b9f4f5de8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:51.672261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-a630458c-0d24-4320-a376-ae4e7bf7b5f0 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:51.674287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a630458c-0d24-4320-a376-ae4e7bf7b5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:51.691735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeceea1a-b6f4-4830-b50a-d85807fc8e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:51.692590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceea1a-b6f4-4830-b50a-d85807fc8e1d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:51.692964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceea1a-b6f4-4830-b50a-d85807fc8e1d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:51.693192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceea1a-b6f4-4830-b50a-d85807fc8e1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:51.704576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeceea1a-b6f4-4830-b50a-d85807fc8e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:51.713673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-aeceea1a-b6f4-4830-b50a-d85807fc8e1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 22 19:40:51.721411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 463/923] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Mar 22 19:40:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:51.722932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeceea1a-b6f4-4830-b50a-d85807fc8e1d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:51.761861 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 461/924] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:51.789558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630458c-0d24-4320-a376-ae4e7bf7b5f0 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:51.851241 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeceea1a-b6f4-4830-b50a-d85807fc8e1d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:51.894167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afc98b-0a3e-42dd-b4e3-5a71151896a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:51.895208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afc98b-0a3e-42dd-b4e3-5a71151896a1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:51.895697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afc98b-0a3e-42dd-b4e3-5a71151896a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:51.896298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afc98b-0a3e-42dd-b4e3-5a71151896a1 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:51.897296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afc98b-0a3e-42dd-b4e3-5a71151896a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:51.898466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afc98b-0a3e-42dd-b4e3-5a71151896a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:51.900393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afc98b-0a3e-42dd-b4e3-5a71151896a1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:51.915671 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 464/925] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Mar 22 19:40:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:51.917661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afc98b-0a3e-42dd-b4e3-5a71151896a1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:51.929953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630458c-0d24-4320-a376-ae4e7bf7b5f0 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:51.971977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a0aff-41ba-4dc5-8613-b34a330bb063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:51.972504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a0aff-41ba-4dc5-8613-b34a330bb063 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:51.973313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a0aff-41ba-4dc5-8613-b34a330bb063 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:51.973734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a0aff-41ba-4dc5-8613-b34a330bb063 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:51.974810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a0aff-41ba-4dc5-8613-b34a330bb063 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:51.976622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a0aff-41ba-4dc5-8613-b34a330bb063 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:51.989720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-706a0aff-41ba-4dc5-8613-b34a330bb063 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 22 19:40:51.996753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 462/926] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Mar 22 19:40:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:51.997989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a0aff-41ba-4dc5-8613-b34a330bb063 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:52.056327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afc98b-0a3e-42dd-b4e3-5a71151896a1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:52.110791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14c56b-147e-4557-954c-81720d3381bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:52.112326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c56b-147e-4557-954c-81720d3381bc None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.112637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a0aff-41ba-4dc5-8613-b34a330bb063 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:52.113367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c56b-147e-4557-954c-81720d3381bc None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.114175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14c56b-147e-4557-954c-81720d3381bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.132841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14c56b-147e-4557-954c-81720d3381bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:52.135117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14c56b-147e-4557-954c-81720d3381bc None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:52.153485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-1b14c56b-147e-4557-954c-81720d3381bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:52.155067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eef12-50c5-461d-86ca-b886319a990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:52.160006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eef12-50c5-461d-86ca-b886319a990f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.160006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eef12-50c5-461d-86ca-b886319a990f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.160006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eef12-50c5-461d-86ca-b886319a990f None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.160006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eef12-50c5-461d-86ca-b886319a990f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:52.160006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eef12-50c5-461d-86ca-b886319a990f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:52.160006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eef12-50c5-461d-86ca-b886319a990f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:52.161035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 465/927] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:52.162548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14c56b-147e-4557-954c-81720d3381bc None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:52.170031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 463/928] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:52.170914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eef12-50c5-461d-86ca-b886319a990f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:52.279107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14c56b-147e-4557-954c-81720d3381bc None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:52.306280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eef12-50c5-461d-86ca-b886319a990f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:52.317678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83827a-80db-4919-b1df-3f61b16a00ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:52.318883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83827a-80db-4919-b1df-3f61b16a00ac None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.319630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83827a-80db-4919-b1df-3f61b16a00ac None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.320209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83827a-80db-4919-b1df-3f61b16a00ac None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.321329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83827a-80db-4919-b1df-3f61b16a00ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:52.321875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83827a-80db-4919-b1df-3f61b16a00ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:52.323604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83827a-80db-4919-b1df-3f61b16a00ac None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:52.342413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 466/929] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:52.344192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83827a-80db-4919-b1df-3f61b16a00ac None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:52.365247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36158237-154c-4882-bb6e-e75f2081d94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:52.366190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36158237-154c-4882-bb6e-e75f2081d94b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.366618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36158237-154c-4882-bb6e-e75f2081d94b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.367141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36158237-154c-4882-bb6e-e75f2081d94b None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.368016 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36158237-154c-4882-bb6e-e75f2081d94b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:52.368518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36158237-154c-4882-bb6e-e75f2081d94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:52.370549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36158237-154c-4882-bb6e-e75f2081d94b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:52.378155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 464/930] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:52.379596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266397a-9757-4297-83b1-97d4127a20de None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.379937 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266397a-9757-4297-83b1-97d4127a20de None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.380425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266397a-9757-4297-83b1-97d4127a20de None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.384308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 465/931] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:52.386468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266397a-9757-4297-83b1-97d4127a20de None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:52.463589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83827a-80db-4919-b1df-3f61b16a00ac None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:52.501747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8dda-92a8-45a2-b471-515ef1bb2795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:52.502590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8dda-92a8-45a2-b471-515ef1bb2795 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.502856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8dda-92a8-45a2-b471-515ef1bb2795 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.503138 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8dda-92a8-45a2-b471-515ef1bb2795 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.511098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266397a-9757-4297-83b1-97d4127a20de None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:52.511802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc8dda-92a8-45a2-b471-515ef1bb2795 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:52.513025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc8dda-92a8-45a2-b471-515ef1bb2795 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:52.528449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-bbbc8dda-92a8-45a2-b471-515ef1bb2795 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 22 19:40:52.534803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 467/932] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:40:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:52.534803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c7697-eafe-4e08-9650-038dd16dbb63 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.534803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c7697-eafe-4e08-9650-038dd16dbb63 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.534803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c7697-eafe-4e08-9650-038dd16dbb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.550136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d62c7697-eafe-4e08-9650-038dd16dbb63 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:52.551356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d62c7697-eafe-4e08-9650-038dd16dbb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:52.557017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27393e-c60c-4469-8a8b-c115637bf959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:52.557703 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27393e-c60c-4469-8a8b-c115637bf959 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.558032 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27393e-c60c-4469-8a8b-c115637bf959 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.558306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27393e-c60c-4469-8a8b-c115637bf959 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.559060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27393e-c60c-4469-8a8b-c115637bf959 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:52.560483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27393e-c60c-4469-8a8b-c115637bf959 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:52.585668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 466/933] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Mar 22 19:40:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:40:52.586977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27393e-c60c-4469-8a8b-c115637bf959 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:52.662812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 468/934] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:52.685710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c7697-eafe-4e08-9650-038dd16dbb63 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:52.735314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27393e-c60c-4469-8a8b-c115637bf959 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:52.773571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c626f-0005-400b-ab54-27f6b312bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:52.774687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c626f-0005-400b-ab54-27f6b312bba0 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.775174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c626f-0005-400b-ab54-27f6b312bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.775664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c626f-0005-400b-ab54-27f6b312bba0 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.776727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c626f-0005-400b-ab54-27f6b312bba0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:52.777277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c626f-0005-400b-ab54-27f6b312bba0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:52.779139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c626f-0005-400b-ab54-27f6b312bba0 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:52.799760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 467/935] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Mar 22 19:40:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:52.806334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c626f-0005-400b-ab54-27f6b312bba0 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:52.835647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c7697-eafe-4e08-9650-038dd16dbb63 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:52.891682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64eb907-42e8-47bc-b838-50f250a6d328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:52.892757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64eb907-42e8-47bc-b838-50f250a6d328 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:52.893187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64eb907-42e8-47bc-b838-50f250a6d328 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:52.893603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64eb907-42e8-47bc-b838-50f250a6d328 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:52.894551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64eb907-42e8-47bc-b838-50f250a6d328 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:52.896122 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64eb907-42e8-47bc-b838-50f250a6d328 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:52.911065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-f64eb907-42e8-47bc-b838-50f250a6d328 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 22 19:40:52.912339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 469/936] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:40:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:52.918981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64eb907-42e8-47bc-b838-50f250a6d328 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:52.952701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c626f-0005-400b-ab54-27f6b312bba0 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:53.001366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe07281-b73b-48a3-8766-13f07a651cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:53.002604 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe07281-b73b-48a3-8766-13f07a651cd2 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.003104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe07281-b73b-48a3-8766-13f07a651cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.003575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe07281-b73b-48a3-8766-13f07a651cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.015110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe07281-b73b-48a3-8766-13f07a651cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:53.017012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe07281-b73b-48a3-8766-13f07a651cd2 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:53.035573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-ffe07281-b73b-48a3-8766-13f07a651cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:53.037531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 468/937] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:53.043510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe07281-b73b-48a3-8766-13f07a651cd2 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:53.099411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64eb907-42e8-47bc-b838-50f250a6d328 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:53.144828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adc254-a3ac-4d39-9ee8-d771f5e3261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:53.145896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc254-a3ac-4d39-9ee8-d771f5e3261d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.146398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc254-a3ac-4d39-9ee8-d771f5e3261d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.146860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc254-a3ac-4d39-9ee8-d771f5e3261d None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.147844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adc254-a3ac-4d39-9ee8-d771f5e3261d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:53.148372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adc254-a3ac-4d39-9ee8-d771f5e3261d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:53.150093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adc254-a3ac-4d39-9ee8-d771f5e3261d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:53.155935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 470/938] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:40:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:53.161200 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adc254-a3ac-4d39-9ee8-d771f5e3261d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:53.184325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe07281-b73b-48a3-8766-13f07a651cd2 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:53.263066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff3494-f45b-4d45-b100-37ad56f8c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:53.264587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff3494-f45b-4d45-b100-37ad56f8c7a4 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.265105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff3494-f45b-4d45-b100-37ad56f8c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.265884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff3494-f45b-4d45-b100-37ad56f8c7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.266903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff3494-f45b-4d45-b100-37ad56f8c7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:53.267413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff3494-f45b-4d45-b100-37ad56f8c7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:53.269252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff3494-f45b-4d45-b100-37ad56f8c7a4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:53.284372 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 469/939] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:53.290595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff3494-f45b-4d45-b100-37ad56f8c7a4 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:53.299143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adc254-a3ac-4d39-9ee8-d771f5e3261d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:53.344331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3e16b-142d-42ce-897a-745ed071e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:53.345772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3e16b-142d-42ce-897a-745ed071e8e7 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.346310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3e16b-142d-42ce-897a-745ed071e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.347127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3e16b-142d-42ce-897a-745ed071e8e7 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.348510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3e16b-142d-42ce-897a-745ed071e8e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:53.349054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3e16b-142d-42ce-897a-745ed071e8e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:53.351183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3e16b-142d-42ce-897a-745ed071e8e7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:53.363342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 471/940] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Mar 22 19:40:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:53.367280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3e16b-142d-42ce-897a-745ed071e8e7 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:53.449779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff3494-f45b-4d45-b100-37ad56f8c7a4 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:53.492354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361a9a1-8d38-4dfb-b3da-6c5610432885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:53.493613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361a9a1-8d38-4dfb-b3da-6c5610432885 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.494158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361a9a1-8d38-4dfb-b3da-6c5610432885 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.494645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361a9a1-8d38-4dfb-b3da-6c5610432885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.496794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3e16b-142d-42ce-897a-745ed071e8e7 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:53.503753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361a9a1-8d38-4dfb-b3da-6c5610432885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:53.505686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361a9a1-8d38-4dfb-b3da-6c5610432885 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:53.521171 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a361a9a1-8d38-4dfb-b3da-6c5610432885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:53.523648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 470/941] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:53.530827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361a9a1-8d38-4dfb-b3da-6c5610432885 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:53.541854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b6c42-05d5-4f40-8284-ea6e6176aec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:53.542834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b6c42-05d5-4f40-8284-ea6e6176aec4 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.543188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b6c42-05d5-4f40-8284-ea6e6176aec4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.543519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b6c42-05d5-4f40-8284-ea6e6176aec4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.544518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b6c42-05d5-4f40-8284-ea6e6176aec4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:53.546192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b6c42-05d5-4f40-8284-ea6e6176aec4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:53.573987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 472/942] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Mar 22 19:40:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:40:53.622814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee82cf-8be4-4f60-80b5-a6c1b81039ec None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.623635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee82cf-8be4-4f60-80b5-a6c1b81039ec None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.624179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee82cf-8be4-4f60-80b5-a6c1b81039ec None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.627412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 473/943] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:53.634003 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb8b07-b711-4052-87e7-2df8f320da56 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.634327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb8b07-b711-4052-87e7-2df8f320da56 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.634539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb8b07-b711-4052-87e7-2df8f320da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.655932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-acbb8b07-b711-4052-87e7-2df8f320da56 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:53.657163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-acbb8b07-b711-4052-87e7-2df8f320da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:53.678544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361a9a1-8d38-4dfb-b3da-6c5610432885 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:53.724371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f971-d0a2-4222-869f-759312dd2300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:53.725055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f971-d0a2-4222-869f-759312dd2300 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.725492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f971-d0a2-4222-869f-759312dd2300 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.725878 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f971-d0a2-4222-869f-759312dd2300 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.726934 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544f971-d0a2-4222-869f-759312dd2300 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:53.727251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544f971-d0a2-4222-869f-759312dd2300 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:53.728747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544f971-d0a2-4222-869f-759312dd2300 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:53.742671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 471/944] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:53.746164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 474/945] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:40:53.748834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f971-d0a2-4222-869f-759312dd2300 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:53.765374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb8b07-b711-4052-87e7-2df8f320da56 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:53.866562 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f971-d0a2-4222-869f-759312dd2300 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:53.911992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb8b07-b711-4052-87e7-2df8f320da56 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:53.920997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30979d-a063-4c01-8813-3a084d748871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:53.921908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30979d-a063-4c01-8813-3a084d748871 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.922216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30979d-a063-4c01-8813-3a084d748871 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.922496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30979d-a063-4c01-8813-3a084d748871 None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/d526f13b514045ec9ebee14edf3fe79f/roles/0b1f8a3d96c0431588550996691555d2` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.924727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30979d-a063-4c01-8813-3a084d748871 None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=d526f13b514045ec9ebee14edf3fe79f, role_id=0b1f8a3d96c0431588550996691555d2)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:53.926212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30979d-a063-4c01-8813-3a084d748871 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:53.954527 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 472/946] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:40:53 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/d526f13b514045ec9ebee14edf3fe79f/roles/0b1f8a3d96c0431588550996691555d2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:40:53.968082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376ac0d-846b-4e0c-a0e4-63c617f805ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:53.969091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376ac0d-846b-4e0c-a0e4-63c617f805ee None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:53.969532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376ac0d-846b-4e0c-a0e4-63c617f805ee None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:53.969873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376ac0d-846b-4e0c-a0e4-63c617f805ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:53.970707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376ac0d-846b-4e0c-a0e4-63c617f805ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:53.972257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376ac0d-846b-4e0c-a0e4-63c617f805ee None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:53.987217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b376ac0d-846b-4e0c-a0e4-63c617f805ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 22 19:40:53.989028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 475/947] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:53.998709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30979d-a063-4c01-8813-3a084d748871 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:54.134881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30979d-a063-4c01-8813-3a084d748871 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:54.172241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67ff44-a757-4af3-8e92-1fbffc457f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:54.173293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67ff44-a757-4af3-8e92-1fbffc457f72 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:54.173783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67ff44-a757-4af3-8e92-1fbffc457f72 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:54.174285 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67ff44-a757-4af3-8e92-1fbffc457f72 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:54.175213 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67ff44-a757-4af3-8e92-1fbffc457f72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:54.175746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67ff44-a757-4af3-8e92-1fbffc457f72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:54.177341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67ff44-a757-4af3-8e92-1fbffc457f72 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:54.183269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 473/948] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:40:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:54.189558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376ac0d-846b-4e0c-a0e4-63c617f805ee None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:54.307290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376ac0d-846b-4e0c-a0e4-63c617f805ee None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:54.349790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69ab37-64a8-46da-a498-1c304d328783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:54.351011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69ab37-64a8-46da-a498-1c304d328783 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:54.351520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69ab37-64a8-46da-a498-1c304d328783 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:54.351995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69ab37-64a8-46da-a498-1c304d328783 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:54.353024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69ab37-64a8-46da-a498-1c304d328783 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:54.353627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69ab37-64a8-46da-a498-1c304d328783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:54.355384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69ab37-64a8-46da-a498-1c304d328783 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:54.361812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 476/949] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:40:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:54.368291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67ff44-a757-4af3-8e92-1fbffc457f72 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:54.489633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67ff44-a757-4af3-8e92-1fbffc457f72 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:54.524411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea5f4f-4157-4374-be78-250291f16e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:54.525973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5f4f-4157-4374-be78-250291f16e7b None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:54.526472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5f4f-4157-4374-be78-250291f16e7b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:54.527068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea5f4f-4157-4374-be78-250291f16e7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:54.528062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea5f4f-4157-4374-be78-250291f16e7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:54.529658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea5f4f-4157-4374-be78-250291f16e7b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:54.552081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 474/950] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Mar 22 19:40:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:40:55.149596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb10901-0394-4216-9c06-8cdd091d6930 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:55.150125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb10901-0394-4216-9c06-8cdd091d6930 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:55.150125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb10901-0394-4216-9c06-8cdd091d6930 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:55.152156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 477/951] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:55.157631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80f67-1b75-406b-a006-ca3b343fd827 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:55.157921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80f67-1b75-406b-a006-ca3b343fd827 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:55.158224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80f67-1b75-406b-a006-ca3b343fd827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:55.175721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4af80f67-1b75-406b-a006-ca3b343fd827 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:55.176921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4af80f67-1b75-406b-a006-ca3b343fd827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:55.254046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 475/952] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:55.278658 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb10901-0394-4216-9c06-8cdd091d6930 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:55.388013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb10901-0394-4216-9c06-8cdd091d6930 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:55.426936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a9760-5d86-41a9-93fb-759532251a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:55.427698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a9760-5d86-41a9-93fb-759532251a64 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:55.427981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a9760-5d86-41a9-93fb-759532251a64 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:55.428291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a9760-5d86-41a9-93fb-759532251a64 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:55.428950 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a9760-5d86-41a9-93fb-759532251a64 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:55.430395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a9760-5d86-41a9-93fb-759532251a64 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:55.441742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-486a9760-5d86-41a9-93fb-759532251a64 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 22 19:40:55.443443 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 478/953] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:55.451387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af80f67-1b75-406b-a006-ca3b343fd827 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:55.558511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af80f67-1b75-406b-a006-ca3b343fd827 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:55.593747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b5e25-9a1f-4ed5-9b15-8c46917cfb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:55.594443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5e25-9a1f-4ed5-9b15-8c46917cfb50 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:55.594723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5e25-9a1f-4ed5-9b15-8c46917cfb50 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:55.595031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5e25-9a1f-4ed5-9b15-8c46917cfb50 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:55.595743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b5e25-9a1f-4ed5-9b15-8c46917cfb50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:55.596049 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b5e25-9a1f-4ed5-9b15-8c46917cfb50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:55.597480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b5e25-9a1f-4ed5-9b15-8c46917cfb50 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:55.603312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 476/954] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:40:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:55.608889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a9760-5d86-41a9-93fb-759532251a64 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:55.715217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a9760-5d86-41a9-93fb-759532251a64 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:55.755076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771cbc1-f6ac-41e5-aa5f-09a782e06d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:55.755788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771cbc1-f6ac-41e5-aa5f-09a782e06d17 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:55.756071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771cbc1-f6ac-41e5-aa5f-09a782e06d17 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:55.756384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771cbc1-f6ac-41e5-aa5f-09a782e06d17 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:55.757118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771cbc1-f6ac-41e5-aa5f-09a782e06d17 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:55.757424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771cbc1-f6ac-41e5-aa5f-09a782e06d17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:55.758977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771cbc1-f6ac-41e5-aa5f-09a782e06d17 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:55.764675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 479/955] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:40:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:56.149752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a17e0-9e54-486b-9bc7-e9c4be229577 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:56.150314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a17e0-9e54-486b-9bc7-e9c4be229577 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:56.150710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a17e0-9e54-486b-9bc7-e9c4be229577 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:56.152977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 477/956] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:56.161679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e5684-4011-49d7-8488-af50d2d65a62 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:56.163696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e5684-4011-49d7-8488-af50d2d65a62 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:56.164499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e5684-4011-49d7-8488-af50d2d65a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:56.192682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-157e5684-4011-49d7-8488-af50d2d65a62 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:56.194939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-157e5684-4011-49d7-8488-af50d2d65a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:56.315230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 480/957] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:56.361916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a17e0-9e54-486b-9bc7-e9c4be229577 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:56.487614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30437-fde3-4aa1-8b3c-48fbc1bc8e24 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:56.487914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30437-fde3-4aa1-8b3c-48fbc1bc8e24 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:56.488190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30437-fde3-4aa1-8b3c-48fbc1bc8e24 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:56.489426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a17e0-9e54-486b-9bc7-e9c4be229577 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:56.490213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 481/958] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:40:56.497995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c465-23ed-4583-9746-6ba460f49c10 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:56.497995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c465-23ed-4583-9746-6ba460f49c10 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:56.497995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c465-23ed-4583-9746-6ba460f49c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:56.516055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-cdd8c465-23ed-4583-9746-6ba460f49c10 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:56.517391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cdd8c465-23ed-4583-9746-6ba460f49c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:56.530716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:56.531760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:56.532213 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:56.532646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:56.534244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:56.536149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:56.537363 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.common [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 22 19:40:56.556943 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.sql.core [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 22 19:40:56.556943 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 22 19:40:56.556943 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [parameters: {'id': 'ac896ecc2b83454fb9b0c9a6cb71de68', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 22 19:40:56.556943 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91344) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 22 19:40:56.574991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac896ecc2b83454fb9b0c9a6cb71de68.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac896ecc2b83454fb9b0c9a6cb71de68. Mar 22 19:40:56.581855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 478/959] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Mar 22 19:40:56 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:56.583283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:56.612189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 482/960] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:40:56.635912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c465-23ed-4583-9746-6ba460f49c10 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:56.723497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8605d-2869-4d2a-a3a4-997b727f56b1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:56.763107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd6bf0-db01-4b51-bd08-3dd4a3546d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:56.763816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd6bf0-db01-4b51-bd08-3dd4a3546d2e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:56.764098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd6bf0-db01-4b51-bd08-3dd4a3546d2e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:56.764379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd6bf0-db01-4b51-bd08-3dd4a3546d2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:56.773317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd6bf0-db01-4b51-bd08-3dd4a3546d2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:56.775439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd6bf0-db01-4b51-bd08-3dd4a3546d2e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:56.803254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-30cd6bf0-db01-4b51-bd08-3dd4a3546d2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:56.806364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 479/961] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:56.811747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd6bf0-db01-4b51-bd08-3dd4a3546d2e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:56.823751 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c465-23ed-4583-9746-6ba460f49c10 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:56.868756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ebf73-1804-451e-8453-99290671a741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:56.869397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ebf73-1804-451e-8453-99290671a741 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:56.869675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ebf73-1804-451e-8453-99290671a741 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:56.869968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ebf73-1804-451e-8453-99290671a741 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:56.881411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ebf73-1804-451e-8453-99290671a741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:40:56.888910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-1c0ebf73-1804-451e-8453-99290671a741 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 22 19:40:56.890638 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 483/962] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Mar 22 19:40:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:56.900644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ebf73-1804-451e-8453-99290671a741 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:56.966283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd6bf0-db01-4b51-bd08-3dd4a3546d2e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:57.007001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8eeba-200c-4606-870a-771683aed616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:57.007888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8eeba-200c-4606-870a-771683aed616 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:57.008234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8eeba-200c-4606-870a-771683aed616 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:57.008598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8eeba-200c-4606-870a-771683aed616 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:57.009373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8eeba-200c-4606-870a-771683aed616 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:57.009679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8eeba-200c-4606-870a-771683aed616 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:57.011181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8eeba-200c-4606-870a-771683aed616 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:57.019647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ebf73-1804-451e-8453-99290671a741 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:57.038461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 480/963] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:40:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:57.040608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721d55b-0970-4d44-b478-3f7bc8889750 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:57.041208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721d55b-0970-4d44-b478-3f7bc8889750 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:57.041805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721d55b-0970-4d44-b478-3f7bc8889750 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:57.044618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 481/964] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:57.053530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7238a-4b40-4835-ba93-91c035ab40e8 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:57.053885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7238a-4b40-4835-ba93-91c035ab40e8 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:57.054124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7238a-4b40-4835-ba93-91c035ab40e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:57.074794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b265c13-59cf-476a-b602-dcccef828ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:57.075511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b265c13-59cf-476a-b602-dcccef828ad4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:57.075750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b265c13-59cf-476a-b602-dcccef828ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:57.076028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b265c13-59cf-476a-b602-dcccef828ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:57.076814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b265c13-59cf-476a-b602-dcccef828ad4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:57.077115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b265c13-59cf-476a-b602-dcccef828ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:57.078667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b265c13-59cf-476a-b602-dcccef828ad4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:57.082238 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-eff7238a-4b40-4835-ba93-91c035ab40e8 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:57.086426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-eff7238a-4b40-4835-ba93-91c035ab40e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:57.094155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 484/965] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Mar 22 19:40:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:40:57.095296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b265c13-59cf-476a-b602-dcccef828ad4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:57.186623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 482/966] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:40:57.205694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7238a-4b40-4835-ba93-91c035ab40e8 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:57.231311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b265c13-59cf-476a-b602-dcccef828ad4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:57.275988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4e29e-572f-4395-b63b-2098cc51e2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:57.276728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4e29e-572f-4395-b63b-2098cc51e2fe None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:57.277011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4e29e-572f-4395-b63b-2098cc51e2fe None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:57.277463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4e29e-572f-4395-b63b-2098cc51e2fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:57.293635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4e29e-572f-4395-b63b-2098cc51e2fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:57.296650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4e29e-572f-4395-b63b-2098cc51e2fe None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:57.332099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-27c4e29e-572f-4395-b63b-2098cc51e2fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:57.333738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 485/967] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:57.343564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4e29e-572f-4395-b63b-2098cc51e2fe None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:57.343805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7238a-4b40-4835-ba93-91c035ab40e8 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:57.403946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f79dd2-ee91-4390-83c1-4ce8d85b716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:57.405341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f79dd2-ee91-4390-83c1-4ce8d85b716a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:57.405827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f79dd2-ee91-4390-83c1-4ce8d85b716a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:57.406721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f79dd2-ee91-4390-83c1-4ce8d85b716a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:57.407939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f79dd2-ee91-4390-83c1-4ce8d85b716a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:57.410540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f79dd2-ee91-4390-83c1-4ce8d85b716a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:57.431998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-20f79dd2-ee91-4390-83c1-4ce8d85b716a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 22 19:40:57.434692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 483/968] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:40:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:57.444590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f79dd2-ee91-4390-83c1-4ce8d85b716a None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:57.548209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4e29e-572f-4395-b63b-2098cc51e2fe None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:57.612751 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b32d-20fb-41ed-af1b-ddc7abf194b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:57.614645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b32d-20fb-41ed-af1b-ddc7abf194b5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:57.615934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b32d-20fb-41ed-af1b-ddc7abf194b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:57.616902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b32d-20fb-41ed-af1b-ddc7abf194b5 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:57.618200 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b32d-20fb-41ed-af1b-ddc7abf194b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:57.619573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b32d-20fb-41ed-af1b-ddc7abf194b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:57.621728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89b32d-20fb-41ed-af1b-ddc7abf194b5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:57.626118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f79dd2-ee91-4390-83c1-4ce8d85b716a None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:57.648214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 486/969] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:57.660032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b32d-20fb-41ed-af1b-ddc7abf194b5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:57.693058 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff47b7-9cdd-409e-b026-921cb4e90f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:57.694412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff47b7-9cdd-409e-b026-921cb4e90f96 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:57.694848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff47b7-9cdd-409e-b026-921cb4e90f96 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:57.695341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff47b7-9cdd-409e-b026-921cb4e90f96 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:57.696404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff47b7-9cdd-409e-b026-921cb4e90f96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:57.696953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff47b7-9cdd-409e-b026-921cb4e90f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:57.699602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff47b7-9cdd-409e-b026-921cb4e90f96 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:57.717114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 484/970] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:40:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:57.718966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff47b7-9cdd-409e-b026-921cb4e90f96 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:57.916481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b32d-20fb-41ed-af1b-ddc7abf194b5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:57.960118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff47b7-9cdd-409e-b026-921cb4e90f96 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:57.961906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ade082-ea25-4345-a810-869bfb144613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:57.963878 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ade082-ea25-4345-a810-869bfb144613 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:57.964363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ade082-ea25-4345-a810-869bfb144613 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:57.964843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ade082-ea25-4345-a810-869bfb144613 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:57.975112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ade082-ea25-4345-a810-869bfb144613 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:57.977178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ade082-ea25-4345-a810-869bfb144613 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:57.996180 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-93ade082-ea25-4345-a810-869bfb144613 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 22 19:40:58.002782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 487/971] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:40:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:40:58.004574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ade082-ea25-4345-a810-869bfb144613 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:58.015070 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975d92a-1293-4f3f-87ac-6d52be8990b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:58.016658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975d92a-1293-4f3f-87ac-6d52be8990b3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:58.016658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975d92a-1293-4f3f-87ac-6d52be8990b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:58.017115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975d92a-1293-4f3f-87ac-6d52be8990b3 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:58.018474 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975d92a-1293-4f3f-87ac-6d52be8990b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:58.019017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975d92a-1293-4f3f-87ac-6d52be8990b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:58.021132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975d92a-1293-4f3f-87ac-6d52be8990b3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:58.034903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 485/972] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:40:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:58.037254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975d92a-1293-4f3f-87ac-6d52be8990b3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:58.139703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ade082-ea25-4345-a810-869bfb144613 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:58.165523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975d92a-1293-4f3f-87ac-6d52be8990b3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:58.180006 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06ff7e-cc83-4208-b90d-7eaec69b17e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:58.181065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ff7e-cc83-4208-b90d-7eaec69b17e0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:58.181551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ff7e-cc83-4208-b90d-7eaec69b17e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:58.182051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ff7e-cc83-4208-b90d-7eaec69b17e0 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:58.183411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06ff7e-cc83-4208-b90d-7eaec69b17e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:58.183942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06ff7e-cc83-4208-b90d-7eaec69b17e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:58.185907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06ff7e-cc83-4208-b90d-7eaec69b17e0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:58.201129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea918dc-d860-4b88-a94b-342060ae1f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:58.201849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea918dc-d860-4b88-a94b-342060ae1f7d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:58.202161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea918dc-d860-4b88-a94b-342060ae1f7d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:58.202483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea918dc-d860-4b88-a94b-342060ae1f7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:58.203291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea918dc-d860-4b88-a94b-342060ae1f7d None admin] RBAC: Adding query filter params (interface=admin, service_id=0cc086cf932e48c8b5d98a8d22c0718d, region_id=RegionOne) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:58.203600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea918dc-d860-4b88-a94b-342060ae1f7d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:58.204977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea918dc-d860-4b88-a94b-342060ae1f7d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:58.213966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 486/973] 10.222.0.49 () {56 vars in 1249 bytes} [Tue Mar 22 19:40:58 2022] GET /identity/v3/endpoints?service_id=0cc086cf932e48c8b5d98a8d22c0718d&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:58.214307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 488/974] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Mar 22 19:40:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:58.216406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea918dc-d860-4b88-a94b-342060ae1f7d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:58.222041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06ff7e-cc83-4208-b90d-7eaec69b17e0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:58.327334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea918dc-d860-4b88-a94b-342060ae1f7d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:58.334434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06ff7e-cc83-4208-b90d-7eaec69b17e0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:58.367685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2b471-d060-48aa-84e4-03ea21733bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:58.368630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b471-d060-48aa-84e4-03ea21733bfe None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:58.368960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b471-d060-48aa-84e4-03ea21733bfe None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:58.369194 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2b471-d060-48aa-84e4-03ea21733bfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:58.372567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6e9d3-1cc9-4717-9e55-7c3639c5fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:58.373254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6e9d3-1cc9-4717-9e55-7c3639c5fbbc None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:58.373525 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6e9d3-1cc9-4717-9e55-7c3639c5fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:58.373792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6e9d3-1cc9-4717-9e55-7c3639c5fbbc None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:58.374536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6e9d3-1cc9-4717-9e55-7c3639c5fbbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:58.376067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6e9d3-1cc9-4717-9e55-7c3639c5fbbc None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:58.383172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 489/975] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Mar 22 19:40:58 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:40:58.384604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107037ab-8c3e-4790-9877-161568561c54 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:58.384886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107037ab-8c3e-4790-9877-161568561c54 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:58.385153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107037ab-8c3e-4790-9877-161568561c54 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:58.392299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 490/976] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:58.394973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb72d5-56af-40ae-80bf-5ad6a0397840 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:58.394973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb72d5-56af-40ae-80bf-5ad6a0397840 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:58.394973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb72d5-56af-40ae-80bf-5ad6a0397840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:58.415095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-59eb72d5-56af-40ae-80bf-5ad6a0397840 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:58.416567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-59eb72d5-56af-40ae-80bf-5ad6a0397840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:58.471744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2b471-d060-48aa-84e4-03ea21733bfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:58.473606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2b471-d060-48aa-84e4-03ea21733bfe None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:58.548549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 491/977] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:58.573730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb72d5-56af-40ae-80bf-5ad6a0397840 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:58.620006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 487/978] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:40:58 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:40:58.626924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2b471-d060-48aa-84e4-03ea21733bfe None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:58.684433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb72d5-56af-40ae-80bf-5ad6a0397840 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:58.720967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f66b-8cd3-433f-9896-84540ea502b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:58.721657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f66b-8cd3-433f-9896-84540ea502b1 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:58.721965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f66b-8cd3-433f-9896-84540ea502b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:58.722285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f66b-8cd3-433f-9896-84540ea502b1 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:58.723396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96f66b-8cd3-433f-9896-84540ea502b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:58.724825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96f66b-8cd3-433f-9896-84540ea502b1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:58.736193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2b471-d060-48aa-84e4-03ea21733bfe None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:58.743620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 492/979] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:40:58 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:40:58.799066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f2cb0-7468-4a39-8484-580a3d92a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:58.800005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f2cb0-7468-4a39-8484-580a3d92a5a6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:58.800333 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f2cb0-7468-4a39-8484-580a3d92a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:58.800608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f2cb0-7468-4a39-8484-580a3d92a5a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:58.816263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f2cb0-7468-4a39-8484-580a3d92a5a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:58.817793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f2cb0-7468-4a39-8484-580a3d92a5a6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:58.844126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-f70f2cb0-7468-4a39-8484-580a3d92a5a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:40:58.850513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 488/980] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:58.854630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f66b-8cd3-433f-9896-84540ea502b1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:58.989541 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f66b-8cd3-433f-9896-84540ea502b1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:59.030338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d6418-5114-44df-9561-7e3caaccb4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:59.031097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d6418-5114-44df-9561-7e3caaccb4a1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:59.031428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d6418-5114-44df-9561-7e3caaccb4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:59.031806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d6418-5114-44df-9561-7e3caaccb4a1 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:59.032537 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d6418-5114-44df-9561-7e3caaccb4a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:59.032844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d6418-5114-44df-9561-7e3caaccb4a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:59.034420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d6418-5114-44df-9561-7e3caaccb4a1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:59.049997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 493/981] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:59.057124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f2cb0-7468-4a39-8484-580a3d92a5a6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:59.180490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f2cb0-7468-4a39-8484-580a3d92a5a6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:59.220344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b65db-f6bd-499b-a8e1-55151a05840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:59.221160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b65db-f6bd-499b-a8e1-55151a05840f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:59.221436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b65db-f6bd-499b-a8e1-55151a05840f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:59.221706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b65db-f6bd-499b-a8e1-55151a05840f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:59.230661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b65db-f6bd-499b-a8e1-55151a05840f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:59.232197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b65db-f6bd-499b-a8e1-55151a05840f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:59.248638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-fc3b65db-f6bd-499b-a8e1-55151a05840f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:40:59.250251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 489/982] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:40:59.256885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d6418-5114-44df-9561-7e3caaccb4a1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:59.369144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d6418-5114-44df-9561-7e3caaccb4a1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:59.408569 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5610-68a3-4be2-922c-901e18569d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:59.409272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5610-68a3-4be2-922c-901e18569d62 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:59.409550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5610-68a3-4be2-922c-901e18569d62 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:59.409825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5610-68a3-4be2-922c-901e18569d62 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:59.410698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5610-68a3-4be2-922c-901e18569d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:59.411010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5610-68a3-4be2-922c-901e18569d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:59.412557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5610-68a3-4be2-922c-901e18569d62 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:59.426667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 494/983] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:59.433637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b65db-f6bd-499b-a8e1-55151a05840f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:59.548370 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b65db-f6bd-499b-a8e1-55151a05840f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:59.586924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f5b54-abd0-4466-93a6-eda6ee7afee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:59.587597 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f5b54-abd0-4466-93a6-eda6ee7afee2 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:59.587875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f5b54-abd0-4466-93a6-eda6ee7afee2 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:59.588146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f5b54-abd0-4466-93a6-eda6ee7afee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:59.588980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f5b54-abd0-4466-93a6-eda6ee7afee2 None admin] RBAC: Adding query filter params (role.id=0b1f8a3d96c0431588550996691555d2, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=d526f13b514045ec9ebee14edf3fe79f) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:40:59.589287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f5b54-abd0-4466-93a6-eda6ee7afee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:59.590777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f5b54-abd0-4466-93a6-eda6ee7afee2 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:59.597686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 490/984] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:40:59 2022] GET /identity/v3/role_assignments?user.id=d526f13b514045ec9ebee14edf3fe79f&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=0b1f8a3d96c0431588550996691555d2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:40:59.625477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65920f-d8b3-401b-9e4a-1a6494364472 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:59.625966 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65920f-d8b3-401b-9e4a-1a6494364472 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:59.626466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65920f-d8b3-401b-9e4a-1a6494364472 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:59.629628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 495/985] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:40:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:40:59.636299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28156f2-519b-41f6-9ae1-01c9c2341bce None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:59.636982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28156f2-519b-41f6-9ae1-01c9c2341bce None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:59.636982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28156f2-519b-41f6-9ae1-01c9c2341bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:59.658882 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c28156f2-519b-41f6-9ae1-01c9c2341bce None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:40:59.660129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c28156f2-519b-41f6-9ae1-01c9c2341bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:40:59.762075 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 491/986] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:40:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:40:59.787814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65920f-d8b3-401b-9e4a-1a6494364472 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:40:59.926139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65920f-d8b3-401b-9e4a-1a6494364472 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:40:59.968174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:40:59.969116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:40:59.969662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:40:59.970269 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:40:59.971322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:40:59.974109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:40:59.976106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.common [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 22 19:40:59.990962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.sql.core [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 22 19:40:59.990962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 22 19:40:59.990962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [parameters: {'user_id': '20d69ecf58f44e7eae9413f28fab1d69', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 22 19:40:59.990962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 22 19:40:59.999338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 22 19:41:00.001319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 496/987] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Mar 22 19:40:59 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:00.007353 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28156f2-519b-41f6-9ae1-01c9c2341bce None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:00.134626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28156f2-519b-41f6-9ae1-01c9c2341bce None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:00.172087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fbc40-e94c-4fd1-be53-c93950de19fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:00.172901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fbc40-e94c-4fd1-be53-c93950de19fb None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:00.173178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fbc40-e94c-4fd1-be53-c93950de19fb None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:00.173447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fbc40-e94c-4fd1-be53-c93950de19fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:00.182099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fbc40-e94c-4fd1-be53-c93950de19fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:00.183579 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fbc40-e94c-4fd1-be53-c93950de19fb None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:00.199011 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-290fbc40-e94c-4fd1-be53-c93950de19fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 22 19:41:00.200686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 492/988] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:41:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:00.206524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:00.321712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648337ba-da67-4d21-a193-30ed436554f3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:00.366297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414ed2a-ac08-4d3f-b0d3-1d9f07aff3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:00.367296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ed2a-ac08-4d3f-b0d3-1d9f07aff3e9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:00.367647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ed2a-ac08-4d3f-b0d3-1d9f07aff3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:00.367922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ed2a-ac08-4d3f-b0d3-1d9f07aff3e9 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:00.368754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ed2a-ac08-4d3f-b0d3-1d9f07aff3e9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:00.369063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ed2a-ac08-4d3f-b0d3-1d9f07aff3e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:00.371075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ed2a-ac08-4d3f-b0d3-1d9f07aff3e9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:00.416354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 497/989] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Mar 22 19:41:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:00.910112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250388b-b393-4341-b5f2-025e5cef8d09 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:00.910654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250388b-b393-4341-b5f2-025e5cef8d09 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:00.910654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250388b-b393-4341-b5f2-025e5cef8d09 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:00.912484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 493/990] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:00.918610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d04c64-2e21-4d2d-b339-9e0d42a2bd1b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:00.918950 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d04c64-2e21-4d2d-b339-9e0d42a2bd1b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:00.919317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d04c64-2e21-4d2d-b339-9e0d42a2bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:00.938903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-52d04c64-2e21-4d2d-b339-9e0d42a2bd1b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:00.940609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-52d04c64-2e21-4d2d-b339-9e0d42a2bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:01.011516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 498/991] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:01.034615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250388b-b393-4341-b5f2-025e5cef8d09 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:01.139575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250388b-b393-4341-b5f2-025e5cef8d09 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:01.172203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60233aee-ef71-486a-bde7-4818ee1a10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:01.173013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233aee-ef71-486a-bde7-4818ee1a10d9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:01.173288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233aee-ef71-486a-bde7-4818ee1a10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:01.173557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233aee-ef71-486a-bde7-4818ee1a10d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:01.174240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233aee-ef71-486a-bde7-4818ee1a10d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:01.175611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233aee-ef71-486a-bde7-4818ee1a10d9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:01.186826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-60233aee-ef71-486a-bde7-4818ee1a10d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 22 19:41:01.188163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 494/992] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Mar 22 19:41:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:01.194066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d04c64-2e21-4d2d-b339-9e0d42a2bd1b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:01.288926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d04c64-2e21-4d2d-b339-9e0d42a2bd1b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:01.319038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1abaef-4952-45ed-af96-65a0c3224f75 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:01.319766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1abaef-4952-45ed-af96-65a0c3224f75 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:01.320044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1abaef-4952-45ed-af96-65a0c3224f75 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:01.321673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df726b2f-54ff-4e29-9aa6-cd499f169ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:01.322460 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df726b2f-54ff-4e29-9aa6-cd499f169ed6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:01.322727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df726b2f-54ff-4e29-9aa6-cd499f169ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:01.323083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df726b2f-54ff-4e29-9aa6-cd499f169ed6 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:01.323857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df726b2f-54ff-4e29-9aa6-cd499f169ed6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:01.324274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df726b2f-54ff-4e29-9aa6-cd499f169ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:01.325600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 495/993] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:41:01.325970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df726b2f-54ff-4e29-9aa6-cd499f169ed6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:01.327317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d28fe-98fc-4b38-98d9-282a95f46edb None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:01.327605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d28fe-98fc-4b38-98d9-282a95f46edb None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:01.327867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d28fe-98fc-4b38-98d9-282a95f46edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:01.336676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 499/994] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:41:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:01.338219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df726b2f-54ff-4e29-9aa6-cd499f169ed6 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:01.345453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-ae8d28fe-98fc-4b38-98d9-282a95f46edb None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:01.346651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ae8d28fe-98fc-4b38-98d9-282a95f46edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:01.417576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 496/995] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:01.440746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d28fe-98fc-4b38-98d9-282a95f46edb None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:01.443220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df726b2f-54ff-4e29-9aa6-cd499f169ed6 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:01.478918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f36d-8c3c-41cb-aeb8-bfe4d80faf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:01.479591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f36d-8c3c-41cb-aeb8-bfe4d80faf0b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:01.479932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f36d-8c3c-41cb-aeb8-bfe4d80faf0b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:01.480208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f36d-8c3c-41cb-aeb8-bfe4d80faf0b None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:01.480975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f36d-8c3c-41cb-aeb8-bfe4d80faf0b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:01.481287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f36d-8c3c-41cb-aeb8-bfe4d80faf0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:01.482715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f36d-8c3c-41cb-aeb8-bfe4d80faf0b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:01.487811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 500/996] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Mar 22 19:41:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:01.493750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f36d-8c3c-41cb-aeb8-bfe4d80faf0b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:01.544195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d28fe-98fc-4b38-98d9-282a95f46edb None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:01.577344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b929f66-0e94-416b-8aaf-f2d9d735a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:01.578184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b929f66-0e94-416b-8aaf-f2d9d735a5e7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:01.578468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b929f66-0e94-416b-8aaf-f2d9d735a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:01.578745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b929f66-0e94-416b-8aaf-f2d9d735a5e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:01.579411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b929f66-0e94-416b-8aaf-f2d9d735a5e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:01.580789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b929f66-0e94-416b-8aaf-f2d9d735a5e7 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:01.592578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-4b929f66-0e94-416b-8aaf-f2d9d735a5e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 22 19:41:01.593791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 497/997] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:41:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:01.596042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f36d-8c3c-41cb-aeb8-bfe4d80faf0b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:01.600120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b929f66-0e94-416b-8aaf-f2d9d735a5e7 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:01.629990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8227c-8ffc-4b17-8553-b3deb7d60d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:01.630684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8227c-8ffc-4b17-8553-b3deb7d60d5e None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:01.630969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8227c-8ffc-4b17-8553-b3deb7d60d5e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:01.631471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8227c-8ffc-4b17-8553-b3deb7d60d5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:01.632214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8227c-8ffc-4b17-8553-b3deb7d60d5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:01.633609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8227c-8ffc-4b17-8553-b3deb7d60d5e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:01.657989 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 501/998] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Mar 22 19:41:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:41:01.718293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b929f66-0e94-416b-8aaf-f2d9d735a5e7 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:01.764729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb7e4-ae09-4d3c-8434-813db333bf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:01.765431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb7e4-ae09-4d3c-8434-813db333bf90 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:01.765707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb7e4-ae09-4d3c-8434-813db333bf90 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:01.766006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb7e4-ae09-4d3c-8434-813db333bf90 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:01.766789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb7e4-ae09-4d3c-8434-813db333bf90 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:01.767095 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb7e4-ae09-4d3c-8434-813db333bf90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:01.768583 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb7e4-ae09-4d3c-8434-813db333bf90 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:01.775029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 498/999] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:41:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:01.781335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8227c-8ffc-4b17-8553-b3deb7d60d5e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:01.896041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8227c-8ffc-4b17-8553-b3deb7d60d5e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:01.930551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3ed44-80f1-433e-83ac-d2f3f2d8c7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:01.931421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3ed44-80f1-433e-83ac-d2f3f2d8c7d9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:01.931797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3ed44-80f1-433e-83ac-d2f3f2d8c7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:01.932165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3ed44-80f1-433e-83ac-d2f3f2d8c7d9 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:01.932988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3ed44-80f1-433e-83ac-d2f3f2d8c7d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:01.933393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3ed44-80f1-433e-83ac-d2f3f2d8c7d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:01.934908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3ed44-80f1-433e-83ac-d2f3f2d8c7d9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:01.945135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 502/1000] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:41:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:01.946706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb7e4-ae09-4d3c-8434-813db333bf90 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:02.049135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb7e4-ae09-4d3c-8434-813db333bf90 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:02.082257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beb881-79b2-41b6-82c5-7b08ed764fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:02.082924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb881-79b2-41b6-82c5-7b08ed764fc5 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:02.083202 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb881-79b2-41b6-82c5-7b08ed764fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:02.083477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beb881-79b2-41b6-82c5-7b08ed764fc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:02.084377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb881-79b2-41b6-82c5-7b08ed764fc5 None admin] RBAC: Adding query filter params (interface=public, service_id=513bbeef7c7d4c6fbfc109af670f483a, region_id=RegionOne) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:02.084728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb881-79b2-41b6-82c5-7b08ed764fc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:02.086141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beb881-79b2-41b6-82c5-7b08ed764fc5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:02.091476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 499/1001] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Mar 22 19:41:01 2022] GET /identity/v3/endpoints?service_id=513bbeef7c7d4c6fbfc109af670f483a&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:02.097015 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3ed44-80f1-433e-83ac-d2f3f2d8c7d9 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:02.127926 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b445b0-6ef2-4b6e-800f-fb2efff98006 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:02.128215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b445b0-6ef2-4b6e-800f-fb2efff98006 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:02.128494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b445b0-6ef2-4b6e-800f-fb2efff98006 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:02.130465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 500/1002] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:02.135652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07347-9d47-4bb4-88fd-f4b75ae15921 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:02.135938 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07347-9d47-4bb4-88fd-f4b75ae15921 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:02.136212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07347-9d47-4bb4-88fd-f4b75ae15921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:02.155074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-70c07347-9d47-4bb4-88fd-f4b75ae15921 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:02.156289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-70c07347-9d47-4bb4-88fd-f4b75ae15921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:02.204650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3ed44-80f1-433e-83ac-d2f3f2d8c7d9 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:02.235899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 501/1003] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:02.244352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc7e4a-a5ef-4c77-8ebd-12705ce1a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:02.245482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc7e4a-a5ef-4c77-8ebd-12705ce1a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:02.245954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc7e4a-a5ef-4c77-8ebd-12705ce1a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:02.246241 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc7e4a-a5ef-4c77-8ebd-12705ce1a3c2 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:02.246919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc7e4a-a5ef-4c77-8ebd-12705ce1a3c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:02.248306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc7e4a-a5ef-4c77-8ebd-12705ce1a3c2 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:02.257704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 503/1004] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Mar 22 19:41:02 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:41:02.258719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c07347-9d47-4bb4-88fd-f4b75ae15921 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:02.372497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c07347-9d47-4bb4-88fd-f4b75ae15921 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:02.411003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a601e-7725-4bbe-9a9b-5adee4ad3ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:02.411833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a601e-7725-4bbe-9a9b-5adee4ad3ab8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:02.412110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a601e-7725-4bbe-9a9b-5adee4ad3ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:02.412510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a601e-7725-4bbe-9a9b-5adee4ad3ab8 None admin] PATH_INFO: `/v3/services/image` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:02.413251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a601e-7725-4bbe-9a9b-5adee4ad3ab8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:02.414701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a601e-7725-4bbe-9a9b-5adee4ad3ab8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:02.426745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-f61a601e-7725-4bbe-9a9b-5adee4ad3ab8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 22 19:41:02.428260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 502/1005] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Mar 22 19:41:02 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:02.434609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc7e4a-a5ef-4c77-8ebd-12705ce1a3c2 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:02.551379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc7e4a-a5ef-4c77-8ebd-12705ce1a3c2 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:02.595143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e9d61-7602-4434-8bb5-33a525a269ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:02.596202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e9d61-7602-4434-8bb5-33a525a269ac None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:02.596662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e9d61-7602-4434-8bb5-33a525a269ac None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:02.597104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e9d61-7602-4434-8bb5-33a525a269ac None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:02.598355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e9d61-7602-4434-8bb5-33a525a269ac None admin] RBAC: Adding query filter params (name=image) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:02.598865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e9d61-7602-4434-8bb5-33a525a269ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:02.601081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e9d61-7602-4434-8bb5-33a525a269ac None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:02.611151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 504/1006] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:02.612777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a601e-7725-4bbe-9a9b-5adee4ad3ab8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:02.731887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a601e-7725-4bbe-9a9b-5adee4ad3ab8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:02.769872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed9ad2-8bdc-47e3-bd2e-275f4c5d55d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:02.770589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed9ad2-8bdc-47e3-bd2e-275f4c5d55d1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:02.770873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed9ad2-8bdc-47e3-bd2e-275f4c5d55d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:02.771146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed9ad2-8bdc-47e3-bd2e-275f4c5d55d1 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:02.772001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed9ad2-8bdc-47e3-bd2e-275f4c5d55d1 None admin] RBAC: Adding query filter params (type=image) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:02.772306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed9ad2-8bdc-47e3-bd2e-275f4c5d55d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:02.773693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed9ad2-8bdc-47e3-bd2e-275f4c5d55d1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:02.786029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 503/1007] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:04.028994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897a019-956c-4c09-a012-ff5a91a89a98 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:04.029832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897a019-956c-4c09-a012-ff5a91a89a98 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:04.029832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897a019-956c-4c09-a012-ff5a91a89a98 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:04.031592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 505/1008] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:41:04.036920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f02e0-77e3-4c8c-b8fd-4c688dcd12bb None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:04.037407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f02e0-77e3-4c8c-b8fd-4c688dcd12bb None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:04.038756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f02e0-77e3-4c8c-b8fd-4c688dcd12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:04.055541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4a8f02e0-77e3-4c8c-b8fd-4c688dcd12bb None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:04.056730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4a8f02e0-77e3-4c8c-b8fd-4c688dcd12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:04.133286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 504/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:04 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:04.157376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897a019-956c-4c09-a012-ff5a91a89a98 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:04.278454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897a019-956c-4c09-a012-ff5a91a89a98 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:04.320217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073f842-c707-4032-b7e5-0fbfda2db531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:04.321043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073f842-c707-4032-b7e5-0fbfda2db531 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:04.321303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073f842-c707-4032-b7e5-0fbfda2db531 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:04.321573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073f842-c707-4032-b7e5-0fbfda2db531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:04.322907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073f842-c707-4032-b7e5-0fbfda2db531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:04.324451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073f842-c707-4032-b7e5-0fbfda2db531 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:04.326501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 506/1010] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:04.332224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f02e0-77e3-4c8c-b8fd-4c688dcd12bb None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:04.471217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f02e0-77e3-4c8c-b8fd-4c688dcd12bb None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:04.516191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30f4bf-9334-4b87-aed2-d08a05c9a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:04.518524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f4bf-9334-4b87-aed2-d08a05c9a803 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:04.518524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f4bf-9334-4b87-aed2-d08a05c9a803 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:04.518524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f4bf-9334-4b87-aed2-d08a05c9a803 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:04.518524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f4bf-9334-4b87-aed2-d08a05c9a803 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:04.519582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f4bf-9334-4b87-aed2-d08a05c9a803 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:04.551656 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 505/1011] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:41:04 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:41:04.600649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfea39-7067-4d28-92a5-8e0786199f02 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:04.600990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfea39-7067-4d28-92a5-8e0786199f02 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:04.601276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfea39-7067-4d28-92a5-8e0786199f02 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:04.603339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 507/1012] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:04.611815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd2d0-73d9-4912-b850-2a06e2623f78 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:04.612181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd2d0-73d9-4912-b850-2a06e2623f78 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:04.612569 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd2d0-73d9-4912-b850-2a06e2623f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:04.633669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-77ecd2d0-73d9-4912-b850-2a06e2623f78 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:04.634965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-77ecd2d0-73d9-4912-b850-2a06e2623f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:04.720170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 506/1013] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:04 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:04.744827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfea39-7067-4d28-92a5-8e0786199f02 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:04.871302 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfea39-7067-4d28-92a5-8e0786199f02 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:04.907176 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95449ea6-ac0d-400b-823e-0d8fd3a6fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:04.911868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95449ea6-ac0d-400b-823e-0d8fd3a6fb75 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:04.911868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95449ea6-ac0d-400b-823e-0d8fd3a6fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:04.911868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95449ea6-ac0d-400b-823e-0d8fd3a6fb75 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:04.912397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95449ea6-ac0d-400b-823e-0d8fd3a6fb75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:04.914651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95449ea6-ac0d-400b-823e-0d8fd3a6fb75 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:04.932679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-95449ea6-ac0d-400b-823e-0d8fd3a6fb75 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 22 19:41:04.934977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 508/1014] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:41:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:04.940173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd2d0-73d9-4912-b850-2a06e2623f78 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:05.047092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd2d0-73d9-4912-b850-2a06e2623f78 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:05.082128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d31fb-d8d6-401d-961d-804b59dc39a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:05.082876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d31fb-d8d6-401d-961d-804b59dc39a0 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:05.083188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d31fb-d8d6-401d-961d-804b59dc39a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:05.083484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d31fb-d8d6-401d-961d-804b59dc39a0 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:05.084327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d31fb-d8d6-401d-961d-804b59dc39a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:05.084638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d31fb-d8d6-401d-961d-804b59dc39a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:05.086105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d31fb-d8d6-401d-961d-804b59dc39a0 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:05.091774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 507/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:41:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:05.097487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95449ea6-ac0d-400b-823e-0d8fd3a6fb75 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:05.201649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95449ea6-ac0d-400b-823e-0d8fd3a6fb75 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:05.238153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437426-e768-4c31-a050-9d11b5722277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:05.238826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437426-e768-4c31-a050-9d11b5722277 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:05.239098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437426-e768-4c31-a050-9d11b5722277 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:05.239690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437426-e768-4c31-a050-9d11b5722277 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:05.240077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437426-e768-4c31-a050-9d11b5722277 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:05.240405 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437426-e768-4c31-a050-9d11b5722277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:05.241319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93c12-80fe-4c91-8eb8-9fb48c6dcc1d None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:05.241611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93c12-80fe-4c91-8eb8-9fb48c6dcc1d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:05.241892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e93c12-80fe-4c91-8eb8-9fb48c6dcc1d None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:05.242249 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437426-e768-4c31-a050-9d11b5722277 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:05.244241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 508/1016] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:41:05.247816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 509/1017] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Mar 22 19:41:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:05.249978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ba94-7898-43a8-8bce-6ed3136295e1 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:05.250298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ba94-7898-43a8-8bce-6ed3136295e1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:05.250523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ba94-7898-43a8-8bce-6ed3136295e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:05.253078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437426-e768-4c31-a050-9d11b5722277 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:05.270122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0923ba94-7898-43a8-8bce-6ed3136295e1 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:05.271992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0923ba94-7898-43a8-8bce-6ed3136295e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:05.341199 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 509/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:41:05.355429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437426-e768-4c31-a050-9d11b5722277 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:05.366113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ba94-7898-43a8-8bce-6ed3136295e1 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:05.393634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd140e6f-a4cc-4409-8921-7af56d192da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:05.394339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd140e6f-a4cc-4409-8921-7af56d192da7 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:05.394619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd140e6f-a4cc-4409-8921-7af56d192da7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:05.394897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd140e6f-a4cc-4409-8921-7af56d192da7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:05.395636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd140e6f-a4cc-4409-8921-7af56d192da7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:05.397050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd140e6f-a4cc-4409-8921-7af56d192da7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:05.422047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 510/1019] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Mar 22 19:41:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:41:05.474254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ba94-7898-43a8-8bce-6ed3136295e1 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:05.519754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea18d51-3178-414e-8834-81a9f4143f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:05.520859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea18d51-3178-414e-8834-81a9f4143f8b None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:05.521354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea18d51-3178-414e-8834-81a9f4143f8b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:05.521931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea18d51-3178-414e-8834-81a9f4143f8b None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:05.522934 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea18d51-3178-414e-8834-81a9f4143f8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:05.524579 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea18d51-3178-414e-8834-81a9f4143f8b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:05.550029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 510/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:41:05 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:41:07.035631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2ae7-3cfa-44f4-92d7-3a5edf6f94d9 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:07.036179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2ae7-3cfa-44f4-92d7-3a5edf6f94d9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:07.036179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa2ae7-3cfa-44f4-92d7-3a5edf6f94d9 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:07.038029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 511/1021] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:07.044310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134739-6e15-4cd2-8a96-e309e333388e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:07.044989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134739-6e15-4cd2-8a96-e309e333388e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:07.044989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134739-6e15-4cd2-8a96-e309e333388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:07.062164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-5d134739-6e15-4cd2-8a96-e309e333388e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:07.063391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5d134739-6e15-4cd2-8a96-e309e333388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:07.140247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 511/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:07.165320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa2ae7-3cfa-44f4-92d7-3a5edf6f94d9 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:07.269766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa2ae7-3cfa-44f4-92d7-3a5edf6f94d9 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:07.306788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1eb39b-85b0-4994-9af2-ef1c70ceffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:07.307599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eb39b-85b0-4994-9af2-ef1c70ceffa0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:07.307924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eb39b-85b0-4994-9af2-ef1c70ceffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:07.308225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eb39b-85b0-4994-9af2-ef1c70ceffa0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:07.309424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1eb39b-85b0-4994-9af2-ef1c70ceffa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:07.310904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1eb39b-85b0-4994-9af2-ef1c70ceffa0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:07.312753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 512/1023] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:07.318324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134739-6e15-4cd2-8a96-e309e333388e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:07.432574 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134739-6e15-4cd2-8a96-e309e333388e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:07.470628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee6af8-529e-4b66-b6da-e5bfec634b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:07.471314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee6af8-529e-4b66-b6da-e5bfec634b57 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:07.471593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee6af8-529e-4b66-b6da-e5bfec634b57 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:07.471867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee6af8-529e-4b66-b6da-e5bfec634b57 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:07.472602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee6af8-529e-4b66-b6da-e5bfec634b57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:07.474512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee6af8-529e-4b66-b6da-e5bfec634b57 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:07.499635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 512/1024] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:41:07 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:41:07.861990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716165-5e7e-459d-89ec-e7bc4a6f5302 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:07.862294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716165-5e7e-459d-89ec-e7bc4a6f5302 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:07.862556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716165-5e7e-459d-89ec-e7bc4a6f5302 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:07.864416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 513/1025] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:07.869826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6f98-0918-4c7a-9325-1c7b4e02f3b5 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:07.870158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6f98-0918-4c7a-9325-1c7b4e02f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:07.870444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6f98-0918-4c7a-9325-1c7b4e02f3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:07.887324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-307f6f98-0918-4c7a-9325-1c7b4e02f3b5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:07.888510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-307f6f98-0918-4c7a-9325-1c7b4e02f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:07.918083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6aae-dd6c-4d23-b14d-3ecdf79ef0d3 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:07.918383 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6aae-dd6c-4d23-b14d-3ecdf79ef0d3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:07.918675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6aae-dd6c-4d23-b14d-3ecdf79ef0d3 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:07.920460 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 514/1026] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:07.925647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612d2fe-883b-4f6d-baea-bc55e5e69799 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:07.925931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612d2fe-883b-4f6d-baea-bc55e5e69799 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:07.926227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612d2fe-883b-4f6d-baea-bc55e5e69799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:07.942593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-5612d2fe-883b-4f6d-baea-bc55e5e69799 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:07.943983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5612d2fe-883b-4f6d-baea-bc55e5e69799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:07.965453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 513/1027] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:07.990107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f6f98-0918-4c7a-9325-1c7b4e02f3b5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.011978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 515/1028] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:41:08.034825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612d2fe-883b-4f6d-baea-bc55e5e69799 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.089471 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f6f98-0918-4c7a-9325-1c7b4e02f3b5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.124971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06417b1e-50fb-4ef2-ad55-f6ad15b11aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.125776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417b1e-50fb-4ef2-ad55-f6ad15b11aa8 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.126080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417b1e-50fb-4ef2-ad55-f6ad15b11aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.126336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417b1e-50fb-4ef2-ad55-f6ad15b11aa8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.130162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612d2fe-883b-4f6d-baea-bc55e5e69799 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.138465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06417b1e-50fb-4ef2-ad55-f6ad15b11aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:41:08.145798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-06417b1e-50fb-4ef2-ad55-f6ad15b11aa8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 22 19:41:08.147242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 514/1029] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Mar 22 19:41:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:08.153126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06417b1e-50fb-4ef2-ad55-f6ad15b11aa8 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.164839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6b048-4062-466d-a163-55337d124e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.166027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6b048-4062-466d-a163-55337d124e6c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.166311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6b048-4062-466d-a163-55337d124e6c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.166581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6b048-4062-466d-a163-55337d124e6c None admin] PATH_INFO: `/v3/services/image` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.167553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6b048-4062-466d-a163-55337d124e6c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.169094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6b048-4062-466d-a163-55337d124e6c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:08.180173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a6e6b048-4062-466d-a163-55337d124e6c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 22 19:41:08.181379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 516/1030] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:08.187564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6b048-4062-466d-a163-55337d124e6c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.258069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06417b1e-50fb-4ef2-ad55-f6ad15b11aa8 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.287888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6b048-4062-466d-a163-55337d124e6c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.291598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195316bf-6c09-403d-97e1-8d0e203ae23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.292276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195316bf-6c09-403d-97e1-8d0e203ae23f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.292561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195316bf-6c09-403d-97e1-8d0e203ae23f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.292834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195316bf-6c09-403d-97e1-8d0e203ae23f None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.293581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195316bf-6c09-403d-97e1-8d0e203ae23f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:08.293886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195316bf-6c09-403d-97e1-8d0e203ae23f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.295294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195316bf-6c09-403d-97e1-8d0e203ae23f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:08.306282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 515/1031] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:08.309454 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195316bf-6c09-403d-97e1-8d0e203ae23f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.321861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc42e5-8742-4a1a-a79c-738cbd4b728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.322600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc42e5-8742-4a1a-a79c-738cbd4b728d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.322833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc42e5-8742-4a1a-a79c-738cbd4b728d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.323147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc42e5-8742-4a1a-a79c-738cbd4b728d None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.323797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc42e5-8742-4a1a-a79c-738cbd4b728d None admin] RBAC: Adding query filter params (name=image) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:08.324151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc42e5-8742-4a1a-a79c-738cbd4b728d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.325582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc42e5-8742-4a1a-a79c-738cbd4b728d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:08.330847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 517/1032] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:08.336082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc42e5-8742-4a1a-a79c-738cbd4b728d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.407836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195316bf-6c09-403d-97e1-8d0e203ae23f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.442910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc42e5-8742-4a1a-a79c-738cbd4b728d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.451728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b204ebd-e86c-4f27-bcbc-3bf5cc8e1728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.452529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b204ebd-e86c-4f27-bcbc-3bf5cc8e1728 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.452807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b204ebd-e86c-4f27-bcbc-3bf5cc8e1728 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.453080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b204ebd-e86c-4f27-bcbc-3bf5cc8e1728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.464566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b204ebd-e86c-4f27-bcbc-3bf5cc8e1728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.466078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b204ebd-e86c-4f27-bcbc-3bf5cc8e1728 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:08.480331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10e9e-ab2d-4399-9dd7-ae2e164be2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.481006 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10e9e-ab2d-4399-9dd7-ae2e164be2f6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.481291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10e9e-ab2d-4399-9dd7-ae2e164be2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.481568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff10e9e-ab2d-4399-9dd7-ae2e164be2f6 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.482309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff10e9e-ab2d-4399-9dd7-ae2e164be2f6 None admin] RBAC: Adding query filter params (type=image) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:08.482620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff10e9e-ab2d-4399-9dd7-ae2e164be2f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.484004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff10e9e-ab2d-4399-9dd7-ae2e164be2f6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:08.484175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-0b204ebd-e86c-4f27-bcbc-3bf5cc8e1728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:41:08.494154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 518/1033] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:08.494334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 516/1034] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:08.494445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10e9e-ab2d-4399-9dd7-ae2e164be2f6 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.496120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b204ebd-e86c-4f27-bcbc-3bf5cc8e1728 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.594867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff10e9e-ab2d-4399-9dd7-ae2e164be2f6 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.599812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b204ebd-e86c-4f27-bcbc-3bf5cc8e1728 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.628512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8045a8-352c-461a-a327-a5afacfa87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.629181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8045a8-352c-461a-a327-a5afacfa87e4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.629487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8045a8-352c-461a-a327-a5afacfa87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.629723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8045a8-352c-461a-a327-a5afacfa87e4 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.630472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8045a8-352c-461a-a327-a5afacfa87e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:08.630776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8045a8-352c-461a-a327-a5afacfa87e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.632621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8045a8-352c-461a-a327-a5afacfa87e4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:08.634454 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913b4b-d4bf-48a6-988b-d0a043060977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.635151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913b4b-d4bf-48a6-988b-d0a043060977 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.635433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913b4b-d4bf-48a6-988b-d0a043060977 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.635704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913b4b-d4bf-48a6-988b-d0a043060977 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.636838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59913b4b-d4bf-48a6-988b-d0a043060977 None admin] RBAC: Adding query filter params (interface=public, service_id=c5251565e0dd48d689326145ecacdbe2, region_id=RegionOne) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:08.637153 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59913b4b-d4bf-48a6-988b-d0a043060977 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.638652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59913b4b-d4bf-48a6-988b-d0a043060977 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:08.649359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 517/1035] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/endpoints?service_id=c5251565e0dd48d689326145ecacdbe2&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:08.649546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 519/1036] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:08.652519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913b4b-d4bf-48a6-988b-d0a043060977 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.652652 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8045a8-352c-461a-a327-a5afacfa87e4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.750146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8045a8-352c-461a-a327-a5afacfa87e4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.751407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913b4b-d4bf-48a6-988b-d0a043060977 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.783846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf2750-ba01-4219-b377-57277c135da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.784646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf2750-ba01-4219-b377-57277c135da6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.784870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadaa0c-7700-4acd-8800-d0e85fee0f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.784988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf2750-ba01-4219-b377-57277c135da6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.785166 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf2750-ba01-4219-b377-57277c135da6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.785535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadaa0c-7700-4acd-8800-d0e85fee0f63 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.785811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadaa0c-7700-4acd-8800-d0e85fee0f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.786097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadaa0c-7700-4acd-8800-d0e85fee0f63 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.786779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadaa0c-7700-4acd-8800-d0e85fee0f63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.788293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadaa0c-7700-4acd-8800-d0e85fee0f63 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:08.793286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf2750-ba01-4219-b377-57277c135da6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.794869 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 518/1037] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:41:08.794984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf2750-ba01-4219-b377-57277c135da6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:08.808809 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-18bf2750-ba01-4219-b377-57277c135da6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 22 19:41:08.814380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 520/1038] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:08.816302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadaa0c-7700-4acd-8800-d0e85fee0f63 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:08.928403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadaa0c-7700-4acd-8800-d0e85fee0f63 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:08.977225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a8312-f38f-43ee-91e7-f33fc1bf4a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:08.978364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a8312-f38f-43ee-91e7-f33fc1bf4a40 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:08.978842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a8312-f38f-43ee-91e7-f33fc1bf4a40 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:08.979349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a8312-f38f-43ee-91e7-f33fc1bf4a40 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:08.980395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a8312-f38f-43ee-91e7-f33fc1bf4a40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:08.980894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a8312-f38f-43ee-91e7-f33fc1bf4a40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:08.982578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a8312-f38f-43ee-91e7-f33fc1bf4a40 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:09.002004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 519/1039] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Mar 22 19:41:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:09.008063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf2750-ba01-4219-b377-57277c135da6 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:09.111102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf2750-ba01-4219-b377-57277c135da6 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:09.144635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf4d31-09fe-47c4-9422-76bc94095cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:09.145295 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4d31-09fe-47c4-9422-76bc94095cd4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:09.145561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4d31-09fe-47c4-9422-76bc94095cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:09.145831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf4d31-09fe-47c4-9422-76bc94095cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:09.212826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf4d31-09fe-47c4-9422-76bc94095cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:09.214354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf4d31-09fe-47c4-9422-76bc94095cd4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:09.314524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 521/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:41:09.320558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a8312-f38f-43ee-91e7-f33fc1bf4a40 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:09.426477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a8312-f38f-43ee-91e7-f33fc1bf4a40 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:09.460366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c914c-9154-46f8-b9cc-2a8acd187a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:09.461161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c914c-9154-46f8-b9cc-2a8acd187a6e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:09.461443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c914c-9154-46f8-b9cc-2a8acd187a6e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:09.461714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c914c-9154-46f8-b9cc-2a8acd187a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:09.471819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c914c-9154-46f8-b9cc-2a8acd187a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:09.473641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c914c-9154-46f8-b9cc-2a8acd187a6e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:09.490875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-9b6c914c-9154-46f8-b9cc-2a8acd187a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:41:09.492291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 520/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:09.498045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf4d31-09fe-47c4-9422-76bc94095cd4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:09.601627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf4d31-09fe-47c4-9422-76bc94095cd4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:09.636031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c2463-567e-4ec0-862f-5351c439c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:09.636708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c2463-567e-4ec0-862f-5351c439c953 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:09.636987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c2463-567e-4ec0-862f-5351c439c953 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:09.637257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c2463-567e-4ec0-862f-5351c439c953 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:09.638007 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c2463-567e-4ec0-862f-5351c439c953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:09.638317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c2463-567e-4ec0-862f-5351c439c953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:09.639701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c2463-567e-4ec0-862f-5351c439c953 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:09.651787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 522/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:09.657702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c914c-9154-46f8-b9cc-2a8acd187a6e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:09.763097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c914c-9154-46f8-b9cc-2a8acd187a6e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:09.801900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081f4a4-597f-4b3a-a934-435e65394d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:09.802834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081f4a4-597f-4b3a-a934-435e65394d32 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:09.803257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081f4a4-597f-4b3a-a934-435e65394d32 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:09.803641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081f4a4-597f-4b3a-a934-435e65394d32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:09.811122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081f4a4-597f-4b3a-a934-435e65394d32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:09.812588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081f4a4-597f-4b3a-a934-435e65394d32 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:09.826360 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-2081f4a4-597f-4b3a-a934-435e65394d32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:41:09.827761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 521/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:09.833744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c2463-567e-4ec0-862f-5351c439c953 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:09.910921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22894-6a97-41d9-bc5b-2f7dcbedea0d None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:09.911103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22894-6a97-41d9-bc5b-2f7dcbedea0d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:09.911382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22894-6a97-41d9-bc5b-2f7dcbedea0d None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:09.913730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 522/1044] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:09.919427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e8b6-7cfa-4b23-83ee-eaf788755d77 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:09.919776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e8b6-7cfa-4b23-83ee-eaf788755d77 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:09.919974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e8b6-7cfa-4b23-83ee-eaf788755d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:09.937560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-84c4e8b6-7cfa-4b23-83ee-eaf788755d77 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:09.938439 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c2463-567e-4ec0-862f-5351c439c953 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:09.938792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-84c4e8b6-7cfa-4b23-83ee-eaf788755d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:09.977007 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dda3ef-43c6-4e6e-900c-8b561275b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:09.977674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda3ef-43c6-4e6e-900c-8b561275b519 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:09.977986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda3ef-43c6-4e6e-900c-8b561275b519 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:09.978258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dda3ef-43c6-4e6e-900c-8b561275b519 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:09.979063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda3ef-43c6-4e6e-900c-8b561275b519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:09.979366 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda3ef-43c6-4e6e-900c-8b561275b519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:09.980808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dda3ef-43c6-4e6e-900c-8b561275b519 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:09.998828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 523/1045] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:41:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:10.000611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dda3ef-43c6-4e6e-900c-8b561275b519 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:10.017976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 523/1046] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:10.041459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e8b6-7cfa-4b23-83ee-eaf788755d77 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:10.108433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dda3ef-43c6-4e6e-900c-8b561275b519 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:10.148385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e8b6-7cfa-4b23-83ee-eaf788755d77 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:10.149313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37974d22-6f56-4019-9494-93c8f6e0a56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:10.150634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37974d22-6f56-4019-9494-93c8f6e0a56e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:10.151093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37974d22-6f56-4019-9494-93c8f6e0a56e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:10.151369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37974d22-6f56-4019-9494-93c8f6e0a56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:10.152222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37974d22-6f56-4019-9494-93c8f6e0a56e None admin] RBAC: Adding query filter params (role.id=0b1f8a3d96c0431588550996691555d2, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=7f74d49fc68344899f70efb85eb1c97d) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:10.152532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37974d22-6f56-4019-9494-93c8f6e0a56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:10.154022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37974d22-6f56-4019-9494-93c8f6e0a56e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:10.160256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 524/1047] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:41:09 2022] GET /identity/v3/role_assignments?user.id=7f74d49fc68344899f70efb85eb1c97d&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=0b1f8a3d96c0431588550996691555d2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:10.189846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48cc89-5573-47ed-902a-d0a63feeb8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:10.190619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48cc89-5573-47ed-902a-d0a63feeb8c4 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:10.190882 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48cc89-5573-47ed-902a-d0a63feeb8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:10.191226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48cc89-5573-47ed-902a-d0a63feeb8c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:10.205300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48cc89-5573-47ed-902a-d0a63feeb8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:41:10.212576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-dd48cc89-5573-47ed-902a-d0a63feeb8c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:41:10.214067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 524/1048] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:10.220272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37974d22-6f56-4019-9494-93c8f6e0a56e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:10.338079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37974d22-6f56-4019-9494-93c8f6e0a56e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:10.378269 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cb17c-4419-40a9-bb67-6f33a59775be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:10.381591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cb17c-4419-40a9-bb67-6f33a59775be None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:10.381591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cb17c-4419-40a9-bb67-6f33a59775be None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:10.381591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cb17c-4419-40a9-bb67-6f33a59775be None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:10.381591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cb17c-4419-40a9-bb67-6f33a59775be None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:10.381591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cb17c-4419-40a9-bb67-6f33a59775be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:10.382303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cb17c-4419-40a9-bb67-6f33a59775be None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:10.395927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 525/1049] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:10.397618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48cc89-5573-47ed-902a-d0a63feeb8c4 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:10.497985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48cc89-5573-47ed-902a-d0a63feeb8c4 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:10.532708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1370464-93f7-4dbd-ace1-2cb4d8ac1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:10.533595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1370464-93f7-4dbd-ace1-2cb4d8ac1f5b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:10.533870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1370464-93f7-4dbd-ace1-2cb4d8ac1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:10.534166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1370464-93f7-4dbd-ace1-2cb4d8ac1f5b None admin] PATH_INFO: `/v3/users/ebc798789fe842a58534eeddafee560f` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:10.548140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1370464-93f7-4dbd-ace1-2cb4d8ac1f5b None admin] RBAC: Authorizing `identity:get_user(user_id=ebc798789fe842a58534eeddafee560f)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:10.549593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1370464-93f7-4dbd-ace1-2cb4d8ac1f5b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:10.551510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 525/1050] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:10 2022] GET /identity/v3/users/ebc798789fe842a58534eeddafee560f => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:10.557684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cb17c-4419-40a9-bb67-6f33a59775be None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:10.660042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cb17c-4419-40a9-bb67-6f33a59775be None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:10.697345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535aea0-8503-45e9-a3ea-7f78fd1cb986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:10.698016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535aea0-8503-45e9-a3ea-7f78fd1cb986 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:10.698298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535aea0-8503-45e9-a3ea-7f78fd1cb986 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:10.698630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535aea0-8503-45e9-a3ea-7f78fd1cb986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:10.767508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535aea0-8503-45e9-a3ea-7f78fd1cb986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:10.768888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535aea0-8503-45e9-a3ea-7f78fd1cb986 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:10.872782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 526/1051] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:41:10.878820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1370464-93f7-4dbd-ace1-2cb4d8ac1f5b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:10.992838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1370464-93f7-4dbd-ace1-2cb4d8ac1f5b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:11.031262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ecad8-89b4-42d2-9b5d-49f5a2d77c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:11.032076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ecad8-89b4-42d2-9b5d-49f5a2d77c15 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:11.032346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ecad8-89b4-42d2-9b5d-49f5a2d77c15 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:11.032615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ecad8-89b4-42d2-9b5d-49f5a2d77c15 None admin] PATH_INFO: `/v3/projects/8798c5817636457aa81a549750a13606` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:11.033989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ecad8-89b4-42d2-9b5d-49f5a2d77c15 None admin] RBAC: Authorizing `identity:get_project(project_id=8798c5817636457aa81a549750a13606)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:11.035500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ecad8-89b4-42d2-9b5d-49f5a2d77c15 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:11.038220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 526/1052] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:41:10 2022] GET /identity/v3/projects/8798c5817636457aa81a549750a13606 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:11.043663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535aea0-8503-45e9-a3ea-7f78fd1cb986 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:11.158446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535aea0-8503-45e9-a3ea-7f78fd1cb986 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:11.198289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f57cf-fe39-41d4-b317-86997544d5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:11.198957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f57cf-fe39-41d4-b317-86997544d5c9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:11.199239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f57cf-fe39-41d4-b317-86997544d5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:11.199511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f57cf-fe39-41d4-b317-86997544d5c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:11.200354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f57cf-fe39-41d4-b317-86997544d5c9 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=8798c5817636457aa81a549750a13606, user.id=ebc798789fe842a58534eeddafee560f) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:11.200668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f57cf-fe39-41d4-b317-86997544d5c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:11.202163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f57cf-fe39-41d4-b317-86997544d5c9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:11.214237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 527/1053] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:41:11 2022] GET /identity/v3/role_assignments?user.id=ebc798789fe842a58534eeddafee560f&scope.project.id=8798c5817636457aa81a549750a13606&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:11.271407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a3a9b-edb5-48bf-910a-b9400c8fd237 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:11.271709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a3a9b-edb5-48bf-910a-b9400c8fd237 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:11.271963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a3a9b-edb5-48bf-910a-b9400c8fd237 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:11.274129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 527/1054] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:11.281449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97151c88-0327-49e0-85da-a7ada2ae31e4 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:11.281646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97151c88-0327-49e0-85da-a7ada2ae31e4 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:11.281889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97151c88-0327-49e0-85da-a7ada2ae31e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:11.301195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-97151c88-0327-49e0-85da-a7ada2ae31e4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:11.302524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-97151c88-0327-49e0-85da-a7ada2ae31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:11.379994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 528/1055] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:11.403914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a3a9b-edb5-48bf-910a-b9400c8fd237 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:11.509574 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a3a9b-edb5-48bf-910a-b9400c8fd237 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:11.540293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61afa1-c9a6-4098-b9f9-a6ef69b92185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:11.541015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61afa1-c9a6-4098-b9f9-a6ef69b92185 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:11.541294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61afa1-c9a6-4098-b9f9-a6ef69b92185 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:11.541564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61afa1-c9a6-4098-b9f9-a6ef69b92185 None admin] PATH_INFO: `/v3/services/image` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:11.542228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61afa1-c9a6-4098-b9f9-a6ef69b92185 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:11.543634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61afa1-c9a6-4098-b9f9-a6ef69b92185 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:11.554919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-7f61afa1-c9a6-4098-b9f9-a6ef69b92185 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 22 19:41:11.556309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 528/1056] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Mar 22 19:41:11 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:11.562324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97151c88-0327-49e0-85da-a7ada2ae31e4 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:11.661733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97151c88-0327-49e0-85da-a7ada2ae31e4 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:11.696234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d3211-17bc-43b1-86bc-0471bce97bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:11.696905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d3211-17bc-43b1-86bc-0471bce97bee None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:11.697185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d3211-17bc-43b1-86bc-0471bce97bee None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:11.697454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d3211-17bc-43b1-86bc-0471bce97bee None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:11.698187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d3211-17bc-43b1-86bc-0471bce97bee None admin] RBAC: Adding query filter params (name=image) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:11.698498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d3211-17bc-43b1-86bc-0471bce97bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:11.699901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d3211-17bc-43b1-86bc-0471bce97bee None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:11.704944 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 529/1057] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:11.710850 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61afa1-c9a6-4098-b9f9-a6ef69b92185 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:11.808687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61afa1-c9a6-4098-b9f9-a6ef69b92185 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:11.845357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d27b8-17ea-403f-945c-c1d4c98be2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:11.846080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d27b8-17ea-403f-945c-c1d4c98be2ae None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:11.846353 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d27b8-17ea-403f-945c-c1d4c98be2ae None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:11.846627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d27b8-17ea-403f-945c-c1d4c98be2ae None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:11.847339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d27b8-17ea-403f-945c-c1d4c98be2ae None admin] RBAC: Adding query filter params (type=image) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:11.847667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d27b8-17ea-403f-945c-c1d4c98be2ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:11.849378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d27b8-17ea-403f-945c-c1d4c98be2ae None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:11.854804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 529/1058] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:11.860534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d3211-17bc-43b1-86bc-0471bce97bee None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:11.962209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d3211-17bc-43b1-86bc-0471bce97bee None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:11.998716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503566a4-1806-437c-92cf-4d749574331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:11.999204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503566a4-1806-437c-92cf-4d749574331a None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:11.999482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503566a4-1806-437c-92cf-4d749574331a None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:11.999758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503566a4-1806-437c-92cf-4d749574331a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:12.000512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503566a4-1806-437c-92cf-4d749574331a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:12.001914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503566a4-1806-437c-92cf-4d749574331a None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:12.021987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 530/1059] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Mar 22 19:41:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:41:12.504345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780259b-d986-4ae3-a255-92e20de0e612 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:12.504903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780259b-d986-4ae3-a255-92e20de0e612 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:12.504903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780259b-d986-4ae3-a255-92e20de0e612 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:12.507287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 530/1060] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:12.512352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8594-c82b-42fd-ade7-a244a4b2bcfb None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:12.512764 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8594-c82b-42fd-ade7-a244a4b2bcfb None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:12.512931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8594-c82b-42fd-ade7-a244a4b2bcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:12.530153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fdbc8594-c82b-42fd-ade7-a244a4b2bcfb None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:12.531322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fdbc8594-c82b-42fd-ade7-a244a4b2bcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:12.603445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 531/1061] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:41:12.625551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780259b-d986-4ae3-a255-92e20de0e612 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:12.725038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780259b-d986-4ae3-a255-92e20de0e612 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:12.758127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117496e-7a06-4f72-8799-c47a53dd59de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:12.758867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117496e-7a06-4f72-8799-c47a53dd59de None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:12.759178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117496e-7a06-4f72-8799-c47a53dd59de None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:12.759445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117496e-7a06-4f72-8799-c47a53dd59de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:12.769858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117496e-7a06-4f72-8799-c47a53dd59de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:41:12.777426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-4117496e-7a06-4f72-8799-c47a53dd59de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 22 19:41:12.778936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 531/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Mar 22 19:41:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:12.784713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8594-c82b-42fd-ade7-a244a4b2bcfb None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:12.883403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8594-c82b-42fd-ade7-a244a4b2bcfb None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:12.915863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27524307-4e27-40ac-8ffd-957b65b5711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:12.916568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524307-4e27-40ac-8ffd-957b65b5711c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:12.916826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524307-4e27-40ac-8ffd-957b65b5711c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:12.917115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524307-4e27-40ac-8ffd-957b65b5711c None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:12.917860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27524307-4e27-40ac-8ffd-957b65b5711c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:12.918195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27524307-4e27-40ac-8ffd-957b65b5711c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:12.919570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27524307-4e27-40ac-8ffd-957b65b5711c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:12.928318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 532/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Mar 22 19:41:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:12.933989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117496e-7a06-4f72-8799-c47a53dd59de None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:13.038679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117496e-7a06-4f72-8799-c47a53dd59de None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:13.071439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e75df4-d3de-4306-81e4-9e7bedaee76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:13.072254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e75df4-d3de-4306-81e4-9e7bedaee76a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:13.072528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e75df4-d3de-4306-81e4-9e7bedaee76a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:13.072798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e75df4-d3de-4306-81e4-9e7bedaee76a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:13.083913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e75df4-d3de-4306-81e4-9e7bedaee76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:13.085570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e75df4-d3de-4306-81e4-9e7bedaee76a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:13.102584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-67e75df4-d3de-4306-81e4-9e7bedaee76a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:41:13.103982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 532/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:13.109590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27524307-4e27-40ac-8ffd-957b65b5711c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:13.214617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27524307-4e27-40ac-8ffd-957b65b5711c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:13.255464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b5c85-48e4-469a-98f2-66d2ba4b7841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:13.256214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b5c85-48e4-469a-98f2-66d2ba4b7841 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:13.256491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b5c85-48e4-469a-98f2-66d2ba4b7841 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:13.256835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b5c85-48e4-469a-98f2-66d2ba4b7841 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:13.257589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b5c85-48e4-469a-98f2-66d2ba4b7841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:13.257899 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b5c85-48e4-469a-98f2-66d2ba4b7841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:13.259377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b5c85-48e4-469a-98f2-66d2ba4b7841 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:13.273379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 533/1065] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:13.278970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e75df4-d3de-4306-81e4-9e7bedaee76a None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:13.387090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e75df4-d3de-4306-81e4-9e7bedaee76a None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:13.419697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41a228-9cba-4d9a-aac4-f956475586fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:13.420495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41a228-9cba-4d9a-aac4-f956475586fc None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:13.420773 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41a228-9cba-4d9a-aac4-f956475586fc None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:13.421044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41a228-9cba-4d9a-aac4-f956475586fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:13.428769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41a228-9cba-4d9a-aac4-f956475586fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:13.430252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41a228-9cba-4d9a-aac4-f956475586fc None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:13.444167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-8c41a228-9cba-4d9a-aac4-f956475586fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 22 19:41:13.445586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 533/1066] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Mar 22 19:41:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:13.451311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b5c85-48e4-469a-98f2-66d2ba4b7841 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:13.555146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b5c85-48e4-469a-98f2-66d2ba4b7841 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:13.591877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaec0f1-39f1-4e04-9143-0e59f602a24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:13.592555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec0f1-39f1-4e04-9143-0e59f602a24f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:13.592834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec0f1-39f1-4e04-9143-0e59f602a24f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:13.593101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaec0f1-39f1-4e04-9143-0e59f602a24f None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:13.593994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec0f1-39f1-4e04-9143-0e59f602a24f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:13.594269 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec0f1-39f1-4e04-9143-0e59f602a24f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:13.595718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaec0f1-39f1-4e04-9143-0e59f602a24f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:13.614654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 534/1067] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Mar 22 19:41:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:13.620128 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaec0f1-39f1-4e04-9143-0e59f602a24f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:13.620499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa1b4-03ab-4e79-a590-4c35982f4dbc None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:13.620966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa1b4-03ab-4e79-a590-4c35982f4dbc None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:13.621079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa1b4-03ab-4e79-a590-4c35982f4dbc None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:13.622973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 534/1068] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:13.628207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5afe7f-27c0-45ac-a0b3-691563780086 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:13.628489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5afe7f-27c0-45ac-a0b3-691563780086 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:13.628763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5afe7f-27c0-45ac-a0b3-691563780086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:13.646373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6d5afe7f-27c0-45ac-a0b3-691563780086 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:13.647780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6d5afe7f-27c0-45ac-a0b3-691563780086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:13.722586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaec0f1-39f1-4e04-9143-0e59f602a24f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:13.726288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 535/1069] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:13.742622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5afe7f-27c0-45ac-a0b3-691563780086 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:13.760977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2f70f-b91a-4197-a60d-b91c2ffa0a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:13.761850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2f70f-b91a-4197-a60d-b91c2ffa0a8f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:13.762152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2f70f-b91a-4197-a60d-b91c2ffa0a8f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:13.762465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2f70f-b91a-4197-a60d-b91c2ffa0a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:13.773706 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2f70f-b91a-4197-a60d-b91c2ffa0a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:13.775210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2f70f-b91a-4197-a60d-b91c2ffa0a8f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:13.792985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-fbb2f70f-b91a-4197-a60d-b91c2ffa0a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:41:13.794308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 535/1070] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:13.800188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2f70f-b91a-4197-a60d-b91c2ffa0a8f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:13.865216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5afe7f-27c0-45ac-a0b3-691563780086 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:13.903768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762d442-1d2c-4222-9264-ab3de6c17458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:13.904511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762d442-1d2c-4222-9264-ab3de6c17458 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:13.904791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762d442-1d2c-4222-9264-ab3de6c17458 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:13.905066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762d442-1d2c-4222-9264-ab3de6c17458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:13.909312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2f70f-b91a-4197-a60d-b91c2ffa0a8f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:13.916563 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762d442-1d2c-4222-9264-ab3de6c17458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:41:13.923948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-6762d442-1d2c-4222-9264-ab3de6c17458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:41:13.925400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 536/1071] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:13.931542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762d442-1d2c-4222-9264-ab3de6c17458 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:13.951066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7d01-3f24-4a20-81c9-be0da2069d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:13.952481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7d01-3f24-4a20-81c9-be0da2069d1a None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:13.952844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7d01-3f24-4a20-81c9-be0da2069d1a None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:13.953224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7d01-3f24-4a20-81c9-be0da2069d1a None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:13.954446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a7d01-3f24-4a20-81c9-be0da2069d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:13.954714 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a7d01-3f24-4a20-81c9-be0da2069d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:13.956348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a7d01-3f24-4a20-81c9-be0da2069d1a None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:13.971347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 536/1072] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:13.977254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7d01-3f24-4a20-81c9-be0da2069d1a None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:14.045587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762d442-1d2c-4222-9264-ab3de6c17458 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:14.091340 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fac19-8443-42ba-877f-7c28bdc09bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:14.092018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fac19-8443-42ba-877f-7c28bdc09bc6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.092291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fac19-8443-42ba-877f-7c28bdc09bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.092728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fac19-8443-42ba-877f-7c28bdc09bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.093380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fac19-8443-42ba-877f-7c28bdc09bc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:14.093689 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fac19-8443-42ba-877f-7c28bdc09bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:14.095105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fac19-8443-42ba-877f-7c28bdc09bc6 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:14.095382 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7d01-3f24-4a20-81c9-be0da2069d1a None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:14.104094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 537/1073] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:14.109807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fac19-8443-42ba-877f-7c28bdc09bc6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:14.130025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb48c1-9d82-4129-ae9d-44615af39e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:14.130876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb48c1-9d82-4129-ae9d-44615af39e01 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.131238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb48c1-9d82-4129-ae9d-44615af39e01 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.131711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb48c1-9d82-4129-ae9d-44615af39e01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.138409 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb48c1-9d82-4129-ae9d-44615af39e01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:14.139859 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb48c1-9d82-4129-ae9d-44615af39e01 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:14.153639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-11cb48c1-9d82-4129-ae9d-44615af39e01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:41:14.159659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 537/1074] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:14.161017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb48c1-9d82-4129-ae9d-44615af39e01 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:14.207043 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fac19-8443-42ba-877f-7c28bdc09bc6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:14.242661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6312ac-9159-47f6-ad0f-568370ae8f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:14.243549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6312ac-9159-47f6-ad0f-568370ae8f3c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.243831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6312ac-9159-47f6-ad0f-568370ae8f3c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.244106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6312ac-9159-47f6-ad0f-568370ae8f3c None admin] PATH_INFO: `/v3/users/ebc798789fe842a58534eeddafee560f` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.245317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6312ac-9159-47f6-ad0f-568370ae8f3c None admin] RBAC: Authorizing `identity:get_user(user_id=ebc798789fe842a58534eeddafee560f)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:14.246798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6312ac-9159-47f6-ad0f-568370ae8f3c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:14.248617 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 538/1075] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:14 2022] GET /identity/v3/users/ebc798789fe842a58534eeddafee560f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:14.254116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6312ac-9159-47f6-ad0f-568370ae8f3c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:14.263109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb48c1-9d82-4129-ae9d-44615af39e01 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:14.298379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78ebb-d745-4e1a-a93c-02c42b4f7da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:14.299046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78ebb-d745-4e1a-a93c-02c42b4f7da4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.299329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78ebb-d745-4e1a-a93c-02c42b4f7da4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.299600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78ebb-d745-4e1a-a93c-02c42b4f7da4 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.300410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78ebb-d745-4e1a-a93c-02c42b4f7da4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:14.300715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78ebb-d745-4e1a-a93c-02c42b4f7da4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:14.302216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78ebb-d745-4e1a-a93c-02c42b4f7da4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:14.319440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 538/1076] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:14.320630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78ebb-d745-4e1a-a93c-02c42b4f7da4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:14.353988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6312ac-9159-47f6-ad0f-568370ae8f3c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:14.390789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce6e11-c063-43ca-8dba-15703b878e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:14.391663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce6e11-c063-43ca-8dba-15703b878e17 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.391944 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce6e11-c063-43ca-8dba-15703b878e17 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.392219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce6e11-c063-43ca-8dba-15703b878e17 None admin] PATH_INFO: `/v3/projects/8798c5817636457aa81a549750a13606` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.393416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce6e11-c063-43ca-8dba-15703b878e17 None admin] RBAC: Authorizing `identity:get_project(project_id=8798c5817636457aa81a549750a13606)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:14.394887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce6e11-c063-43ca-8dba-15703b878e17 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:14.396857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 539/1077] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:41:14 2022] GET /identity/v3/projects/8798c5817636457aa81a549750a13606 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:14.402741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce6e11-c063-43ca-8dba-15703b878e17 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:14.419545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78ebb-d745-4e1a-a93c-02c42b4f7da4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:14.450979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a8ab8-4a9f-42c5-84ba-9864bc620cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:14.451875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a8ab8-4a9f-42c5-84ba-9864bc620cf9 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.452150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a8ab8-4a9f-42c5-84ba-9864bc620cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.452417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a8ab8-4a9f-42c5-84ba-9864bc620cf9 None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/7f74d49fc68344899f70efb85eb1c97d/roles/0b1f8a3d96c0431588550996691555d2` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.454644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a8ab8-4a9f-42c5-84ba-9864bc620cf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=7f74d49fc68344899f70efb85eb1c97d, role_id=0b1f8a3d96c0431588550996691555d2)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:14.456129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a8ab8-4a9f-42c5-84ba-9864bc620cf9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:14.470358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 539/1078] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:41:14 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/7f74d49fc68344899f70efb85eb1c97d/roles/0b1f8a3d96c0431588550996691555d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:41:14.472111 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93ddd8-57e3-4609-a6fc-c33cae72432e None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.472111 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93ddd8-57e3-4609-a6fc-c33cae72432e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.472445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93ddd8-57e3-4609-a6fc-c33cae72432e None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.474672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 540/1079] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:14.483154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b3a9-99b5-4ac5-9656-c042ef1e4e7f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.483438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b3a9-99b5-4ac5-9656-c042ef1e4e7f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.483709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b3a9-99b5-4ac5-9656-c042ef1e4e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.502712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-78e2b3a9-99b5-4ac5-9656-c042ef1e4e7f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:14.503982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-78e2b3a9-99b5-4ac5-9656-c042ef1e4e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:14.506586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce6e11-c063-43ca-8dba-15703b878e17 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:14.543990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fb34e-5ad2-4aae-bf28-ca7cd38fcb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:14.544915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fb34e-5ad2-4aae-bf28-ca7cd38fcb67 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.545250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fb34e-5ad2-4aae-bf28-ca7cd38fcb67 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.545528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fb34e-5ad2-4aae-bf28-ca7cd38fcb67 None admin] PATH_INFO: `/v3/projects/8798c5817636457aa81a549750a13606/users/ebc798789fe842a58534eeddafee560f/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.547637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fb34e-5ad2-4aae-bf28-ca7cd38fcb67 None admin] RBAC: Authorizing `identity:create_grant(project_id=8798c5817636457aa81a549750a13606, user_id=ebc798789fe842a58534eeddafee560f, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:14.549113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fb34e-5ad2-4aae-bf28-ca7cd38fcb67 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:14.565683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 540/1080] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:41:14 2022] PUT /identity/v3/projects/8798c5817636457aa81a549750a13606/users/ebc798789fe842a58534eeddafee560f/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:41:14.589207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 541/1081] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:14.612858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fb34e-5ad2-4aae-bf28-ca7cd38fcb67 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:14.739021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fb34e-5ad2-4aae-bf28-ca7cd38fcb67 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:14.777549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232157-1d67-4028-bb36-465c4df48415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:14.778615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232157-1d67-4028-bb36-465c4df48415 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:14.778946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232157-1d67-4028-bb36-465c4df48415 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:14.779220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37232157-1d67-4028-bb36-465c4df48415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:14.848424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37232157-1d67-4028-bb36-465c4df48415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:14.850072 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37232157-1d67-4028-bb36-465c4df48415 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:14.950154 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 541/1082] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:41:14.956459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b3a9-99b5-4ac5-9656-c042ef1e4e7f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:15.190836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b3a9-99b5-4ac5-9656-c042ef1e4e7f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:15.224807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f1f95-3b28-4581-b754-9ccb23e0f7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:15.225622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1f95-3b28-4581-b754-9ccb23e0f7a3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:15.225900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1f95-3b28-4581-b754-9ccb23e0f7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:15.226197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1f95-3b28-4581-b754-9ccb23e0f7a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:15.236246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f1f95-3b28-4581-b754-9ccb23e0f7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:15.237710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f1f95-3b28-4581-b754-9ccb23e0f7a3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:15.254419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-493f1f95-3b28-4581-b754-9ccb23e0f7a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:41:15.255865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 542/1083] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:15.261919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232157-1d67-4028-bb36-465c4df48415 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:15.366137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37232157-1d67-4028-bb36-465c4df48415 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:15.402761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5aaf4-00af-4c9f-938c-a77b33a3631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:15.403442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5aaf4-00af-4c9f-938c-a77b33a3631d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:15.403719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5aaf4-00af-4c9f-938c-a77b33a3631d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:15.403949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5aaf4-00af-4c9f-938c-a77b33a3631d None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:15.404720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5aaf4-00af-4c9f-938c-a77b33a3631d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:15.405018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5aaf4-00af-4c9f-938c-a77b33a3631d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:15.407498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5aaf4-00af-4c9f-938c-a77b33a3631d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:15.425977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 542/1084] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:16.835070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172621-473f-4a35-a67e-3d190b9f31e2 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:16.835661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172621-473f-4a35-a67e-3d190b9f31e2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:16.835661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172621-473f-4a35-a67e-3d190b9f31e2 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:16.839923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 543/1085] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:16.845030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc895-f292-4df4-8adf-d13d17607872 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:16.845484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc895-f292-4df4-8adf-d13d17607872 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:16.845642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbc895-f292-4df4-8adf-d13d17607872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:16.864030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-e6fbc895-f292-4df4-8adf-d13d17607872 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:16.865598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e6fbc895-f292-4df4-8adf-d13d17607872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:16.936057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8936af-c4d2-4f74-8744-82a9efb317d9 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:16.936340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8936af-c4d2-4f74-8744-82a9efb317d9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:16.936617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8936af-c4d2-4f74-8744-82a9efb317d9 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:16.938554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 544/1086] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:16.938843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 543/1087] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:16.944488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98dc08-3d34-41d3-a9b8-bab38dc75073 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:16.944756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98dc08-3d34-41d3-a9b8-bab38dc75073 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:16.945023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98dc08-3d34-41d3-a9b8-bab38dc75073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:16.963337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-de98dc08-3d34-41d3-a9b8-bab38dc75073 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:16.964514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-de98dc08-3d34-41d3-a9b8-bab38dc75073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:16.965296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbc895-f292-4df4-8adf-d13d17607872 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.033493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 545/1088] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:17.059583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98dc08-3d34-41d3-a9b8-bab38dc75073 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.068995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbc895-f292-4df4-8adf-d13d17607872 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.103973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671b80c-56dc-4c07-8ea9-6b3b3fc37d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.104717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b80c-56dc-4c07-8ea9-6b3b3fc37d4b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.104995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b80c-56dc-4c07-8ea9-6b3b3fc37d4b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.105267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671b80c-56dc-4c07-8ea9-6b3b3fc37d4b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.115402 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671b80c-56dc-4c07-8ea9-6b3b3fc37d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:41:17.122764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-d671b80c-56dc-4c07-8ea9-6b3b3fc37d4b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 22 19:41:17.123982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 544/1089] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Mar 22 19:41:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:17.130180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671b80c-56dc-4c07-8ea9-6b3b3fc37d4b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.159190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98dc08-3d34-41d3-a9b8-bab38dc75073 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.192814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caee20e-736c-4161-898e-f683a606ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.193668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caee20e-736c-4161-898e-f683a606ae50 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.193978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caee20e-736c-4161-898e-f683a606ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.194256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caee20e-736c-4161-898e-f683a606ae50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.204028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caee20e-736c-4161-898e-f683a606ae50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:41:17.210932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-1caee20e-736c-4161-898e-f683a606ae50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:41:17.212109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 546/1090] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:17.218248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caee20e-736c-4161-898e-f683a606ae50 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.228505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671b80c-56dc-4c07-8ea9-6b3b3fc37d4b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.262757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9dd67-6fb1-4b9d-9551-1040c3b33f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.263449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9dd67-6fb1-4b9d-9551-1040c3b33f93 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.263730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9dd67-6fb1-4b9d-9551-1040c3b33f93 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.263995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9dd67-6fb1-4b9d-9551-1040c3b33f93 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.264736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9dd67-6fb1-4b9d-9551-1040c3b33f93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:17.265069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9dd67-6fb1-4b9d-9551-1040c3b33f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:17.266493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9dd67-6fb1-4b9d-9551-1040c3b33f93 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:17.274349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 545/1091] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:17.280117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9dd67-6fb1-4b9d-9551-1040c3b33f93 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.317693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caee20e-736c-4161-898e-f683a606ae50 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.355630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a39e3-61a2-404a-b206-b0f9cd6b2d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.356686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a39e3-61a2-404a-b206-b0f9cd6b2d65 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.357150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a39e3-61a2-404a-b206-b0f9cd6b2d65 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.357660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a39e3-61a2-404a-b206-b0f9cd6b2d65 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.359041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a39e3-61a2-404a-b206-b0f9cd6b2d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:17.359551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a39e3-61a2-404a-b206-b0f9cd6b2d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:17.361352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a39e3-61a2-404a-b206-b0f9cd6b2d65 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:17.370794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 547/1092] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:17.376734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a39e3-61a2-404a-b206-b0f9cd6b2d65 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.382315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9dd67-6fb1-4b9d-9551-1040c3b33f93 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.415975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68bbd6-31ec-4d50-9e5e-42821dccfa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.416767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68bbd6-31ec-4d50-9e5e-42821dccfa2c None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.417044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68bbd6-31ec-4d50-9e5e-42821dccfa2c None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.417316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68bbd6-31ec-4d50-9e5e-42821dccfa2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.428463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68bbd6-31ec-4d50-9e5e-42821dccfa2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:17.429914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68bbd6-31ec-4d50-9e5e-42821dccfa2c None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:17.445996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-4d68bbd6-31ec-4d50-9e5e-42821dccfa2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:41:17.447210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 546/1093] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:17.452905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68bbd6-31ec-4d50-9e5e-42821dccfa2c None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.475407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a39e3-61a2-404a-b206-b0f9cd6b2d65 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.510329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcec097-9a92-4385-9ddc-715b9acc6ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.511204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcec097-9a92-4385-9ddc-715b9acc6ba3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.511489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcec097-9a92-4385-9ddc-715b9acc6ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.511756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcec097-9a92-4385-9ddc-715b9acc6ba3 None admin] PATH_INFO: `/v3/users/ebc798789fe842a58534eeddafee560f` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.513011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcec097-9a92-4385-9ddc-715b9acc6ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=ebc798789fe842a58534eeddafee560f)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:17.514508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcec097-9a92-4385-9ddc-715b9acc6ba3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:17.516125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 548/1094] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/users/ebc798789fe842a58534eeddafee560f => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:17.522075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcec097-9a92-4385-9ddc-715b9acc6ba3 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.552601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68bbd6-31ec-4d50-9e5e-42821dccfa2c None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.586133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a64ce-8e94-4738-96e7-217694d60a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.586803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a64ce-8e94-4738-96e7-217694d60a94 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.587081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a64ce-8e94-4738-96e7-217694d60a94 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.587357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a64ce-8e94-4738-96e7-217694d60a94 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.588194 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a64ce-8e94-4738-96e7-217694d60a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:17.588500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a64ce-8e94-4738-96e7-217694d60a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:17.589877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a64ce-8e94-4738-96e7-217694d60a94 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:17.602345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 547/1095] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:17.608170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a64ce-8e94-4738-96e7-217694d60a94 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.620371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcec097-9a92-4385-9ddc-715b9acc6ba3 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.653581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab03dc-dbc7-4f79-95f6-df01e83c838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.654268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab03dc-dbc7-4f79-95f6-df01e83c838e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.654546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab03dc-dbc7-4f79-95f6-df01e83c838e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.654815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab03dc-dbc7-4f79-95f6-df01e83c838e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.703509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a64ce-8e94-4738-96e7-217694d60a94 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.722376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab03dc-dbc7-4f79-95f6-df01e83c838e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:17.724197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab03dc-dbc7-4f79-95f6-df01e83c838e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:17.736791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78cf2-e7f8-49ea-b3bd-1bc15192d6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.737592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78cf2-e7f8-49ea-b3bd-1bc15192d6c3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.737873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78cf2-e7f8-49ea-b3bd-1bc15192d6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.738178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78cf2-e7f8-49ea-b3bd-1bc15192d6c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.745347 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c78cf2-e7f8-49ea-b3bd-1bc15192d6c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:17.746849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c78cf2-e7f8-49ea-b3bd-1bc15192d6c3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:17.761613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-50c78cf2-e7f8-49ea-b3bd-1bc15192d6c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 22 19:41:17.762857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 548/1096] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:41:17.768648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78cf2-e7f8-49ea-b3bd-1bc15192d6c3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.822110 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 549/1097] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:41:17.828241 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab03dc-dbc7-4f79-95f6-df01e83c838e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.870046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c78cf2-e7f8-49ea-b3bd-1bc15192d6c3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.903104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd4c77-b8ff-4aef-b471-bf78bc1597f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.903793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd4c77-b8ff-4aef-b471-bf78bc1597f1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.904067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd4c77-b8ff-4aef-b471-bf78bc1597f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.904331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd4c77-b8ff-4aef-b471-bf78bc1597f1 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.905157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd4c77-b8ff-4aef-b471-bf78bc1597f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:17.905458 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd4c77-b8ff-4aef-b471-bf78bc1597f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:17.906919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd4c77-b8ff-4aef-b471-bf78bc1597f1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:17.924420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 549/1098] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:17.927224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab03dc-dbc7-4f79-95f6-df01e83c838e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:17.930385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd4c77-b8ff-4aef-b471-bf78bc1597f1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:17.963570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19cd1e-0fc1-4837-9110-5cf126da00e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:17.964447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19cd1e-0fc1-4837-9110-5cf126da00e0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:17.964725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19cd1e-0fc1-4837-9110-5cf126da00e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:17.964991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19cd1e-0fc1-4837-9110-5cf126da00e0 None admin] PATH_INFO: `/v3/projects/8798c5817636457aa81a549750a13606` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:17.966237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19cd1e-0fc1-4837-9110-5cf126da00e0 None admin] RBAC: Authorizing `identity:get_project(project_id=8798c5817636457aa81a549750a13606)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:17.967681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19cd1e-0fc1-4837-9110-5cf126da00e0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:17.969398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 550/1099] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/projects/8798c5817636457aa81a549750a13606 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:17.976534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19cd1e-0fc1-4837-9110-5cf126da00e0 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:18.037737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd4c77-b8ff-4aef-b471-bf78bc1597f1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:18.075847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bca71-221f-4a31-937d-12994fed1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:18.076519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bca71-221f-4a31-937d-12994fed1443 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:18.076782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bca71-221f-4a31-937d-12994fed1443 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:18.077061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bca71-221f-4a31-937d-12994fed1443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:18.080967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19cd1e-0fc1-4837-9110-5cf126da00e0 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:18.114024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d737b-a43b-4e97-828f-003a7199ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:18.114685 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d737b-a43b-4e97-828f-003a7199ec35 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:18.115020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d737b-a43b-4e97-828f-003a7199ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:18.115445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d737b-a43b-4e97-828f-003a7199ec35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:18.116435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d737b-a43b-4e97-828f-003a7199ec35 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=8798c5817636457aa81a549750a13606, user.id=ebc798789fe842a58534eeddafee560f) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:18.116744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d737b-a43b-4e97-828f-003a7199ec35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:18.118202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d737b-a43b-4e97-828f-003a7199ec35 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:18.123842 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 551/1100] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/role_assignments?user.id=ebc798789fe842a58534eeddafee560f&scope.project.id=8798c5817636457aa81a549750a13606&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:18.144408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bca71-221f-4a31-937d-12994fed1443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:18.145910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bca71-221f-4a31-937d-12994fed1443 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:18.254532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 550/1101] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 22 19:41:18.260887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d737b-a43b-4e97-828f-003a7199ec35 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:18.364140 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d737b-a43b-4e97-828f-003a7199ec35 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:18.398793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e337f-8814-465d-b81d-2244ec879e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:18.399528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e337f-8814-465d-b81d-2244ec879e22 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:18.399800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e337f-8814-465d-b81d-2244ec879e22 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:18.400069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e337f-8814-465d-b81d-2244ec879e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:18.410501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e337f-8814-465d-b81d-2244ec879e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:18.412021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e337f-8814-465d-b81d-2244ec879e22 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:18.429337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a56e337f-8814-465d-b81d-2244ec879e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:41:18.430728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 552/1102] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:18.436322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bca71-221f-4a31-937d-12994fed1443 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:18.544091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bca71-221f-4a31-937d-12994fed1443 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:18.579477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550561-7f9d-4c0a-b869-4b6c1f5fdacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:18.580137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550561-7f9d-4c0a-b869-4b6c1f5fdacc None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:18.580413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550561-7f9d-4c0a-b869-4b6c1f5fdacc None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:18.580683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550561-7f9d-4c0a-b869-4b6c1f5fdacc None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:18.581396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550561-7f9d-4c0a-b869-4b6c1f5fdacc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:18.581694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550561-7f9d-4c0a-b869-4b6c1f5fdacc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:18.583095 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550561-7f9d-4c0a-b869-4b6c1f5fdacc None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:18.595028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 551/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:18.601255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e337f-8814-465d-b81d-2244ec879e22 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:18.704055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e337f-8814-465d-b81d-2244ec879e22 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:18.739241 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682f5d2-de2a-43cd-b3ba-fa9fb0092954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:18.740276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682f5d2-de2a-43cd-b3ba-fa9fb0092954 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:18.740640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682f5d2-de2a-43cd-b3ba-fa9fb0092954 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:18.740912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682f5d2-de2a-43cd-b3ba-fa9fb0092954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:18.751618 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682f5d2-de2a-43cd-b3ba-fa9fb0092954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:18.753066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682f5d2-de2a-43cd-b3ba-fa9fb0092954 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:18.766294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-5682f5d2-de2a-43cd-b3ba-fa9fb0092954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:41:18.767634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 553/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:41:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:18.774181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550561-7f9d-4c0a-b869-4b6c1f5fdacc None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:18.885142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550561-7f9d-4c0a-b869-4b6c1f5fdacc None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:18.920530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a239f44-8e51-47bf-8a74-d44a2f95dd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:18.921194 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a239f44-8e51-47bf-8a74-d44a2f95dd54 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:18.921593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a239f44-8e51-47bf-8a74-d44a2f95dd54 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:18.921873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a239f44-8e51-47bf-8a74-d44a2f95dd54 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:18.922704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a239f44-8e51-47bf-8a74-d44a2f95dd54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:18.923017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a239f44-8e51-47bf-8a74-d44a2f95dd54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:18.924510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a239f44-8e51-47bf-8a74-d44a2f95dd54 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:18.937103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 552/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:41:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:18.943644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682f5d2-de2a-43cd-b3ba-fa9fb0092954 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:19.051969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682f5d2-de2a-43cd-b3ba-fa9fb0092954 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:19.103674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5a30f-5404-48ff-b8a4-df6ab79c3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:19.104369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5a30f-5404-48ff-b8a4-df6ab79c3668 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:19.104654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5a30f-5404-48ff-b8a4-df6ab79c3668 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:19.104928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5a30f-5404-48ff-b8a4-df6ab79c3668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:19.105813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5a30f-5404-48ff-b8a4-df6ab79c3668 None admin] RBAC: Adding query filter params (role.id=0b1f8a3d96c0431588550996691555d2, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=7f74d49fc68344899f70efb85eb1c97d) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:19.106164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5a30f-5404-48ff-b8a4-df6ab79c3668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:19.107642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5a30f-5404-48ff-b8a4-df6ab79c3668 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:19.114942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 554/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:41:18 2022] GET /identity/v3/role_assignments?user.id=7f74d49fc68344899f70efb85eb1c97d&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=0b1f8a3d96c0431588550996691555d2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:20.501743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044d4c-3df0-4367-8ad4-523fac79aeb3 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:20.502425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044d4c-3df0-4367-8ad4-523fac79aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:20.502425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9044d4c-3df0-4367-8ad4-523fac79aeb3 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:20.504123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 553/1107] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:20.510279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f3569-c91a-4cfb-8512-01dc2b2c638d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:20.510865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f3569-c91a-4cfb-8512-01dc2b2c638d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:20.510865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f3569-c91a-4cfb-8512-01dc2b2c638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:20.530001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e67f3569-c91a-4cfb-8512-01dc2b2c638d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:20.531219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e67f3569-c91a-4cfb-8512-01dc2b2c638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:20.605963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 555/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:20.632324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044d4c-3df0-4367-8ad4-523fac79aeb3 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:20.745207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9044d4c-3df0-4367-8ad4-523fac79aeb3 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:20.781170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8abdf-dc89-43f4-aa5a-f4837f929318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:20.781891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8abdf-dc89-43f4-aa5a-f4837f929318 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:20.782256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8abdf-dc89-43f4-aa5a-f4837f929318 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:20.782533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8abdf-dc89-43f4-aa5a-f4837f929318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:20.783737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8abdf-dc89-43f4-aa5a-f4837f929318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:20.785169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8abdf-dc89-43f4-aa5a-f4837f929318 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:20.786916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 554/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:20.794943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f3569-c91a-4cfb-8512-01dc2b2c638d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:20.897089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f3569-c91a-4cfb-8512-01dc2b2c638d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:20.931112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef5eb4-b762-47e6-ada2-012573b1afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:20.931783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef5eb4-b762-47e6-ada2-012573b1afb8 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:20.932066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef5eb4-b762-47e6-ada2-012573b1afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:20.932340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef5eb4-b762-47e6-ada2-012573b1afb8 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:20.933044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef5eb4-b762-47e6-ada2-012573b1afb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:20.934530 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef5eb4-b762-47e6-ada2-012573b1afb8 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:20.955791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 556/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:41:20 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:41:23.295009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5778f-b374-454f-9954-326610494af4 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:23.295532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5778f-b374-454f-9954-326610494af4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:23.295532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5778f-b374-454f-9954-326610494af4 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:23.297271 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 555/1111] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:23.302980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514db10-22bf-4dec-9d66-cb27e87f19cf None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:23.303416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514db10-22bf-4dec-9d66-cb27e87f19cf None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:23.303550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514db10-22bf-4dec-9d66-cb27e87f19cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:23.321286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c514db10-22bf-4dec-9d66-cb27e87f19cf None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:23.322519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c514db10-22bf-4dec-9d66-cb27e87f19cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:23.392251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 557/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:23.416147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5778f-b374-454f-9954-326610494af4 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:23.523484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5778f-b374-454f-9954-326610494af4 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:23.558783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979350-ece8-449b-bdc3-42e365626dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:23.559559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979350-ece8-449b-bdc3-42e365626dfe None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:23.559833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979350-ece8-449b-bdc3-42e365626dfe None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:23.560117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979350-ece8-449b-bdc3-42e365626dfe None admin] PATH_INFO: `/v3/roles/3dae28c0ed754e34b0024bbb40d02fb7` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:23.561637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93979350-ece8-449b-bdc3-42e365626dfe None admin] RBAC: Authorizing `identity:get_role(role_id=3dae28c0ed754e34b0024bbb40d02fb7)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:23.563033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93979350-ece8-449b-bdc3-42e365626dfe None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:23.564410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 556/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:23 2022] GET /identity/v3/roles/3dae28c0ed754e34b0024bbb40d02fb7 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:23.570559 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514db10-22bf-4dec-9d66-cb27e87f19cf None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:23.673729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514db10-22bf-4dec-9d66-cb27e87f19cf None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:23.708622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784919-13bb-4569-833c-35a6a2a29e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:23.709634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784919-13bb-4569-833c-35a6a2a29e94 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:23.710020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784919-13bb-4569-833c-35a6a2a29e94 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:23.710292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9784919-13bb-4569-833c-35a6a2a29e94 None admin] PATH_INFO: `/v3/users/e5518221535e47888a96b4e71ef2bddb` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:23.725921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9784919-13bb-4569-833c-35a6a2a29e94 None admin] RBAC: Authorizing `identity:get_user(user_id=e5518221535e47888a96b4e71ef2bddb)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:23.727416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9784919-13bb-4569-833c-35a6a2a29e94 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:23.729173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 558/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:23 2022] GET /identity/v3/users/e5518221535e47888a96b4e71ef2bddb => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:23.735284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979350-ece8-449b-bdc3-42e365626dfe None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:23.848645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979350-ece8-449b-bdc3-42e365626dfe None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:23.886054 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53aafd-0365-4999-a672-e9372ae843b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:23.886698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53aafd-0365-4999-a672-e9372ae843b9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:23.887011 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53aafd-0365-4999-a672-e9372ae843b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:23.887284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53aafd-0365-4999-a672-e9372ae843b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:23.956999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53aafd-0365-4999-a672-e9372ae843b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:23.958512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53aafd-0365-4999-a672-e9372ae843b9 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:24.060842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 557/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:41:24.067043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784919-13bb-4569-833c-35a6a2a29e94 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:24.167909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9784919-13bb-4569-833c-35a6a2a29e94 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:24.202608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92743f-4585-447d-bf18-c6581206a437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:24.203451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92743f-4585-447d-bf18-c6581206a437 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:24.203727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92743f-4585-447d-bf18-c6581206a437 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:24.203997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92743f-4585-447d-bf18-c6581206a437 None admin] PATH_INFO: `/v3/projects/8798c5817636457aa81a549750a13606` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:24.205197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92743f-4585-447d-bf18-c6581206a437 None admin] RBAC: Authorizing `identity:get_project(project_id=8798c5817636457aa81a549750a13606)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:24.206652 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92743f-4585-447d-bf18-c6581206a437 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:24.208323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 559/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:41:24 2022] GET /identity/v3/projects/8798c5817636457aa81a549750a13606 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:41:24.214946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53aafd-0365-4999-a672-e9372ae843b9 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:24.316325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53aafd-0365-4999-a672-e9372ae843b9 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:24.352055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ac168-2ef1-42ed-bbaa-9dc6c85ac053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:24.352709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ac168-2ef1-42ed-bbaa-9dc6c85ac053 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:24.352987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ac168-2ef1-42ed-bbaa-9dc6c85ac053 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:24.353249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ac168-2ef1-42ed-bbaa-9dc6c85ac053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:24.354110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ac168-2ef1-42ed-bbaa-9dc6c85ac053 None admin] RBAC: Adding query filter params (role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=8798c5817636457aa81a549750a13606, user.id=e5518221535e47888a96b4e71ef2bddb) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:24.354413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ac168-2ef1-42ed-bbaa-9dc6c85ac053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:24.355887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ac168-2ef1-42ed-bbaa-9dc6c85ac053 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:24.361575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 558/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:41:24 2022] GET /identity/v3/role_assignments?user.id=e5518221535e47888a96b4e71ef2bddb&scope.project.id=8798c5817636457aa81a549750a13606&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:26.636938 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1466fa-7ea7-49e6-9f0c-cb97d76375c9 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:26.637576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1466fa-7ea7-49e6-9f0c-cb97d76375c9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:26.637576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1466fa-7ea7-49e6-9f0c-cb97d76375c9 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:26.639282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 560/1118] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:26.644676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313817e-5a09-4b65-8117-5a7e0d640a14 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:26.645172 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313817e-5a09-4b65-8117-5a7e0d640a14 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:26.645325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313817e-5a09-4b65-8117-5a7e0d640a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:26.788200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d313817e-5a09-4b65-8117-5a7e0d640a14 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:26.789411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d313817e-5a09-4b65-8117-5a7e0d640a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:26.858907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 559/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:26.882307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1466fa-7ea7-49e6-9f0c-cb97d76375c9 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:26.990580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1466fa-7ea7-49e6-9f0c-cb97d76375c9 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:27.025177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035b557-aebe-45b4-b6b6-bf67635a36c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:27.026063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b557-aebe-45b4-b6b6-bf67635a36c4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:27.026345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b557-aebe-45b4-b6b6-bf67635a36c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:27.026618 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b557-aebe-45b4-b6b6-bf67635a36c4 None admin] PATH_INFO: `/v3/roles/3dae28c0ed754e34b0024bbb40d02fb7` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:27.028143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035b557-aebe-45b4-b6b6-bf67635a36c4 None admin] RBAC: Authorizing `identity:get_role(role_id=3dae28c0ed754e34b0024bbb40d02fb7)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:27.029496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035b557-aebe-45b4-b6b6-bf67635a36c4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:27.030901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 561/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:26 2022] GET /identity/v3/roles/3dae28c0ed754e34b0024bbb40d02fb7 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:27.037584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313817e-5a09-4b65-8117-5a7e0d640a14 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:27.139724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313817e-5a09-4b65-8117-5a7e0d640a14 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:27.173835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc1e0-326e-47a2-9c4f-12833dd3a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:27.174732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc1e0-326e-47a2-9c4f-12833dd3a0d7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:27.174991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc1e0-326e-47a2-9c4f-12833dd3a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:27.175282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc1e0-326e-47a2-9c4f-12833dd3a0d7 None admin] PATH_INFO: `/v3/users/e5518221535e47888a96b4e71ef2bddb` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:27.176521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdc1e0-326e-47a2-9c4f-12833dd3a0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=e5518221535e47888a96b4e71ef2bddb)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:27.178181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdc1e0-326e-47a2-9c4f-12833dd3a0d7 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:27.179835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 560/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:27 2022] GET /identity/v3/users/e5518221535e47888a96b4e71ef2bddb => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:27.185852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035b557-aebe-45b4-b6b6-bf67635a36c4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:27.292279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035b557-aebe-45b4-b6b6-bf67635a36c4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:27.329624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc92da-707a-4ccc-a6bb-61bd9fe4d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:27.330528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc92da-707a-4ccc-a6bb-61bd9fe4d4fb None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:27.330810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc92da-707a-4ccc-a6bb-61bd9fe4d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:27.331081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc92da-707a-4ccc-a6bb-61bd9fe4d4fb None admin] PATH_INFO: `/v3/projects/8798c5817636457aa81a549750a13606` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:27.332341 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc92da-707a-4ccc-a6bb-61bd9fe4d4fb None admin] RBAC: Authorizing `identity:get_project(project_id=8798c5817636457aa81a549750a13606)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:27.334143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc92da-707a-4ccc-a6bb-61bd9fe4d4fb None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:27.335984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 562/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:41:27 2022] GET /identity/v3/projects/8798c5817636457aa81a549750a13606 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:27.342505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc1e0-326e-47a2-9c4f-12833dd3a0d7 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:27.460909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc1e0-326e-47a2-9c4f-12833dd3a0d7 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:27.498317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f074e13-814f-45a6-a3e6-9e3e09e96b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:27.499472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f074e13-814f-45a6-a3e6-9e3e09e96b67 None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:27.500000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f074e13-814f-45a6-a3e6-9e3e09e96b67 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:27.500488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f074e13-814f-45a6-a3e6-9e3e09e96b67 None admin] PATH_INFO: `/v3/projects/8798c5817636457aa81a549750a13606/users/e5518221535e47888a96b4e71ef2bddb/roles/3dae28c0ed754e34b0024bbb40d02fb7` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:27.503307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f074e13-814f-45a6-a3e6-9e3e09e96b67 None admin] RBAC: Authorizing `identity:create_grant(project_id=8798c5817636457aa81a549750a13606, user_id=e5518221535e47888a96b4e71ef2bddb, role_id=3dae28c0ed754e34b0024bbb40d02fb7)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:27.504929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f074e13-814f-45a6-a3e6-9e3e09e96b67 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:27.522029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 561/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:41:27 2022] PUT /identity/v3/projects/8798c5817636457aa81a549750a13606/users/e5518221535e47888a96b4e71ef2bddb/roles/3dae28c0ed754e34b0024bbb40d02fb7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:41:29.802602 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4de68-84f6-42a2-9def-5cc3a7834669 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:29.803196 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4de68-84f6-42a2-9def-5cc3a7834669 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:29.803196 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4de68-84f6-42a2-9def-5cc3a7834669 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:29.804902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 563/1124] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:29.810505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4f10-6285-4bd4-b4b6-a4d0e07eea18 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:29.810958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4f10-6285-4bd4-b4b6-a4d0e07eea18 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:29.811046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4f10-6285-4bd4-b4b6-a4d0e07eea18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:29.829267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-ac5e4f10-6285-4bd4-b4b6-a4d0e07eea18 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:29.830735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ac5e4f10-6285-4bd4-b4b6-a4d0e07eea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:29.903736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 562/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:29.929195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4de68-84f6-42a2-9def-5cc3a7834669 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:30.033699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4de68-84f6-42a2-9def-5cc3a7834669 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:30.068508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476432d-dd92-4c55-8bb1-ea1e415d0f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:30.069391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476432d-dd92-4c55-8bb1-ea1e415d0f7f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:30.069673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476432d-dd92-4c55-8bb1-ea1e415d0f7f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:30.069971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476432d-dd92-4c55-8bb1-ea1e415d0f7f None admin] PATH_INFO: `/v3/roles/3dae28c0ed754e34b0024bbb40d02fb7` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:30.071498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476432d-dd92-4c55-8bb1-ea1e415d0f7f None admin] RBAC: Authorizing `identity:get_role(role_id=3dae28c0ed754e34b0024bbb40d02fb7)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:30.072877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476432d-dd92-4c55-8bb1-ea1e415d0f7f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:30.074308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 564/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:29 2022] GET /identity/v3/roles/3dae28c0ed754e34b0024bbb40d02fb7 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:30.080352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4f10-6285-4bd4-b4b6-a4d0e07eea18 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:30.178315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4f10-6285-4bd4-b4b6-a4d0e07eea18 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:30.213856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6ff4-fd7c-4067-94fd-785146d83ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:30.214757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6ff4-fd7c-4067-94fd-785146d83ac3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:30.215034 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6ff4-fd7c-4067-94fd-785146d83ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:30.215307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6ff4-fd7c-4067-94fd-785146d83ac3 None admin] PATH_INFO: `/v3/users/e5518221535e47888a96b4e71ef2bddb` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:30.216530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6ff4-fd7c-4067-94fd-785146d83ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=e5518221535e47888a96b4e71ef2bddb)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:30.218042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6ff4-fd7c-4067-94fd-785146d83ac3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:30.219666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 563/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:30 2022] GET /identity/v3/users/e5518221535e47888a96b4e71ef2bddb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:30.226210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476432d-dd92-4c55-8bb1-ea1e415d0f7f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:30.330801 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476432d-dd92-4c55-8bb1-ea1e415d0f7f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:30.369134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dc644-69f1-461f-80b8-14528a93c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:30.369799 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dc644-69f1-461f-80b8-14528a93c7af None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:30.370113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dc644-69f1-461f-80b8-14528a93c7af None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:30.370374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dc644-69f1-461f-80b8-14528a93c7af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:30.442849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dc644-69f1-461f-80b8-14528a93c7af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:30.444328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dc644-69f1-461f-80b8-14528a93c7af None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:30.549479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 565/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:41:30.556519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6ff4-fd7c-4067-94fd-785146d83ac3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:30.661723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6ff4-fd7c-4067-94fd-785146d83ac3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:30.696022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213389aa-633e-404b-a749-eae70153ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:30.696872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213389aa-633e-404b-a749-eae70153ec26 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:30.697148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213389aa-633e-404b-a749-eae70153ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:30.697418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213389aa-633e-404b-a749-eae70153ec26 None admin] PATH_INFO: `/v3/projects/8798c5817636457aa81a549750a13606` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:30.698613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213389aa-633e-404b-a749-eae70153ec26 None admin] RBAC: Authorizing `identity:get_project(project_id=8798c5817636457aa81a549750a13606)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:30.700035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213389aa-633e-404b-a749-eae70153ec26 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:30.701705 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 564/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:41:30 2022] GET /identity/v3/projects/8798c5817636457aa81a549750a13606 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:30.708233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dc644-69f1-461f-80b8-14528a93c7af None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:30.806931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dc644-69f1-461f-80b8-14528a93c7af None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:30.842787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46360fb2-0671-408e-9e3a-3b1e3d1407bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:30.843459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46360fb2-0671-408e-9e3a-3b1e3d1407bb None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:30.843744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46360fb2-0671-408e-9e3a-3b1e3d1407bb None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:30.844018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46360fb2-0671-408e-9e3a-3b1e3d1407bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:30.844867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46360fb2-0671-408e-9e3a-3b1e3d1407bb None admin] RBAC: Adding query filter params (role.id=3dae28c0ed754e34b0024bbb40d02fb7, scope.project.id=8798c5817636457aa81a549750a13606, user.id=e5518221535e47888a96b4e71ef2bddb) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:30.845181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46360fb2-0671-408e-9e3a-3b1e3d1407bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:30.846749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46360fb2-0671-408e-9e3a-3b1e3d1407bb None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:30.853168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 566/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:41:30 2022] GET /identity/v3/role_assignments?user.id=e5518221535e47888a96b4e71ef2bddb&scope.project.id=8798c5817636457aa81a549750a13606&role.id=3dae28c0ed754e34b0024bbb40d02fb7 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:33.167650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae9ac-c4e6-4be0-81e6-c3374ec66db6 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:33.168190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae9ac-c4e6-4be0-81e6-c3374ec66db6 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:33.168190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae9ac-c4e6-4be0-81e6-c3374ec66db6 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:33.169876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 565/1131] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:33.175433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220860a3-a6d1-4db1-8ae4-3cad0f0688e0 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:33.175862 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220860a3-a6d1-4db1-8ae4-3cad0f0688e0 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:33.175975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220860a3-a6d1-4db1-8ae4-3cad0f0688e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:33.194228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-220860a3-a6d1-4db1-8ae4-3cad0f0688e0 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:33.195416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-220860a3-a6d1-4db1-8ae4-3cad0f0688e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:33.263723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 567/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:33.287746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ae9ac-c4e6-4be0-81e6-c3374ec66db6 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:33.396492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ae9ac-c4e6-4be0-81e6-c3374ec66db6 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:33.430770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8f70e-38f3-441a-842c-b80a422fe867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:33.431483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8f70e-38f3-441a-842c-b80a422fe867 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:33.431759 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8f70e-38f3-441a-842c-b80a422fe867 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:33.432029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8f70e-38f3-441a-842c-b80a422fe867 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:33.433216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8f70e-38f3-441a-842c-b80a422fe867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:33.434686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8f70e-38f3-441a-842c-b80a422fe867 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:33.436294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 566/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:33.442550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220860a3-a6d1-4db1-8ae4-3cad0f0688e0 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:33.540436 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220860a3-a6d1-4db1-8ae4-3cad0f0688e0 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:33.579755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7367b3a-9543-4c24-8c99-54a7efafd045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:33.580420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7367b3a-9543-4c24-8c99-54a7efafd045 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:33.580697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7367b3a-9543-4c24-8c99-54a7efafd045 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:33.580943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7367b3a-9543-4c24-8c99-54a7efafd045 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:33.581647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7367b3a-9543-4c24-8c99-54a7efafd045 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:33.583177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7367b3a-9543-4c24-8c99-54a7efafd045 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:33.616259 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 568/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:41:33 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:41:35.967336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f73dc-dbde-4a82-bb9d-4f981c46359e None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:35.967897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f73dc-dbde-4a82-bb9d-4f981c46359e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:35.967897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f73dc-dbde-4a82-bb9d-4f981c46359e None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:35.969658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 567/1135] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:35.975564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf13a9-1ebe-4052-8521-1a72c5274614 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:35.976011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf13a9-1ebe-4052-8521-1a72c5274614 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:35.976118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf13a9-1ebe-4052-8521-1a72c5274614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:35.994320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e8bf13a9-1ebe-4052-8521-1a72c5274614 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:35.995543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e8bf13a9-1ebe-4052-8521-1a72c5274614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:36.068620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 569/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:36.094423 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f73dc-dbde-4a82-bb9d-4f981c46359e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:36.200911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f73dc-dbde-4a82-bb9d-4f981c46359e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:36.236947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fde34-92b2-42c9-b30b-3b3921692327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:36.237735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fde34-92b2-42c9-b30b-3b3921692327 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:36.238042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fde34-92b2-42c9-b30b-3b3921692327 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:36.238316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fde34-92b2-42c9-b30b-3b3921692327 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:36.239668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fde34-92b2-42c9-b30b-3b3921692327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:36.241141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fde34-92b2-42c9-b30b-3b3921692327 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:36.242780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 568/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:41:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:36.248743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf13a9-1ebe-4052-8521-1a72c5274614 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:36.356727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf13a9-1ebe-4052-8521-1a72c5274614 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:36.391152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030a901-4828-48d6-948f-3ab99dd01e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:36.391846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030a901-4828-48d6-948f-3ab99dd01e88 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:36.392123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030a901-4828-48d6-948f-3ab99dd01e88 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:36.392392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030a901-4828-48d6-948f-3ab99dd01e88 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:36.393097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030a901-4828-48d6-948f-3ab99dd01e88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:36.394572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030a901-4828-48d6-948f-3ab99dd01e88 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:36.416689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 570/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:41:36 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:41:38.857608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e3075-ddd8-4377-92bc-5291811e0609 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:38.858188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e3075-ddd8-4377-92bc-5291811e0609 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:38.858188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e3075-ddd8-4377-92bc-5291811e0609 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:38.860067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 569/1139] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:38.866315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397523e-f051-460c-8038-08dcbae905b8 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:38.866800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397523e-f051-460c-8038-08dcbae905b8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:38.866800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397523e-f051-460c-8038-08dcbae905b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:38.884449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7397523e-f051-460c-8038-08dcbae905b8 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:38.885586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7397523e-f051-460c-8038-08dcbae905b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:38.959422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 571/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:41:38.985177 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e3075-ddd8-4377-92bc-5291811e0609 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:39.090655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e3075-ddd8-4377-92bc-5291811e0609 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:39.124708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f5a6d-0ed0-4edf-bd5b-92a23caeabf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:39.125491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f5a6d-0ed0-4edf-bd5b-92a23caeabf3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:39.125799 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f5a6d-0ed0-4edf-bd5b-92a23caeabf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:39.126090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f5a6d-0ed0-4edf-bd5b-92a23caeabf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:39.136513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f5a6d-0ed0-4edf-bd5b-92a23caeabf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:41:39.143431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-719f5a6d-0ed0-4edf-bd5b-92a23caeabf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:41:39.144624 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 570/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:39.150997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397523e-f051-460c-8038-08dcbae905b8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:39.248533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397523e-f051-460c-8038-08dcbae905b8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:39.283053 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bc222-ce1a-4147-bab7-24366c35a94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:39.283713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bc222-ce1a-4147-bab7-24366c35a94d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:39.283986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bc222-ce1a-4147-bab7-24366c35a94d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:39.284249 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bc222-ce1a-4147-bab7-24366c35a94d None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:39.284985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bc222-ce1a-4147-bab7-24366c35a94d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:39.285287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bc222-ce1a-4147-bab7-24366c35a94d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:39.287186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bc222-ce1a-4147-bab7-24366c35a94d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:39.295283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 572/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:39.301456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f5a6d-0ed0-4edf-bd5b-92a23caeabf3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:39.406670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f5a6d-0ed0-4edf-bd5b-92a23caeabf3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:39.441261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4915122-a0a8-4ece-86a4-20afa40835d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:39.442152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4915122-a0a8-4ece-86a4-20afa40835d3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:39.442436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4915122-a0a8-4ece-86a4-20afa40835d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:39.442871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4915122-a0a8-4ece-86a4-20afa40835d3 None admin] PATH_INFO: `/v3/users/1cfeeb838041419094f80c86c3e49101` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:39.456083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4915122-a0a8-4ece-86a4-20afa40835d3 None admin] RBAC: Authorizing `identity:get_user(user_id=1cfeeb838041419094f80c86c3e49101)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:39.457533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4915122-a0a8-4ece-86a4-20afa40835d3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:39.459336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 571/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:39 2022] GET /identity/v3/users/1cfeeb838041419094f80c86c3e49101 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:39.465320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bc222-ce1a-4147-bab7-24366c35a94d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:39.567706 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bc222-ce1a-4147-bab7-24366c35a94d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:39.604636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba28f6-73f0-417a-b400-79c13d18b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:39.605279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba28f6-73f0-417a-b400-79c13d18b503 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:39.605555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba28f6-73f0-417a-b400-79c13d18b503 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:39.605824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba28f6-73f0-417a-b400-79c13d18b503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:39.674719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba28f6-73f0-417a-b400-79c13d18b503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:39.676097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba28f6-73f0-417a-b400-79c13d18b503 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:39.779692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 573/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:41:39.785732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4915122-a0a8-4ece-86a4-20afa40835d3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:39.884415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4915122-a0a8-4ece-86a4-20afa40835d3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:39.918388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700c81a-6df4-40b6-88bd-0531326fab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:39.919231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c81a-6df4-40b6-88bd-0531326fab15 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:39.919501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c81a-6df4-40b6-88bd-0531326fab15 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:39.919764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c81a-6df4-40b6-88bd-0531326fab15 None admin] PATH_INFO: `/v3/projects/cdf5d91a4db349e8885de8944728c553` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:39.920980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700c81a-6df4-40b6-88bd-0531326fab15 None admin] RBAC: Authorizing `identity:get_project(project_id=cdf5d91a4db349e8885de8944728c553)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:39.922435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700c81a-6df4-40b6-88bd-0531326fab15 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:39.924096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 572/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:41:39 2022] GET /identity/v3/projects/cdf5d91a4db349e8885de8944728c553 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:39.931070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba28f6-73f0-417a-b400-79c13d18b503 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:40.034516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba28f6-73f0-417a-b400-79c13d18b503 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:40.071732 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cdc36-e132-4d2b-bf9f-3842c325403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:40.072388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cdc36-e132-4d2b-bf9f-3842c325403c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:40.072663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cdc36-e132-4d2b-bf9f-3842c325403c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:40.072929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cdc36-e132-4d2b-bf9f-3842c325403c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:40.073774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cdc36-e132-4d2b-bf9f-3842c325403c None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=cdf5d91a4db349e8885de8944728c553, user.id=1cfeeb838041419094f80c86c3e49101) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:40.074111 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cdc36-e132-4d2b-bf9f-3842c325403c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:40.075543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cdc36-e132-4d2b-bf9f-3842c325403c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:40.081437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 574/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:41:39 2022] GET /identity/v3/role_assignments?user.id=1cfeeb838041419094f80c86c3e49101&scope.project.id=cdf5d91a4db349e8885de8944728c553&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:42.374096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad73992-3bcc-491b-8a10-649f6de8a5bd None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:42.374657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad73992-3bcc-491b-8a10-649f6de8a5bd None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:42.374657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad73992-3bcc-491b-8a10-649f6de8a5bd None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:42.376404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 573/1147] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:42.382057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d466ad-1712-485c-91a2-bfb4aaa32483 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:42.382558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d466ad-1712-485c-91a2-bfb4aaa32483 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:42.382558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d466ad-1712-485c-91a2-bfb4aaa32483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:42.400520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-70d466ad-1712-485c-91a2-bfb4aaa32483 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:42.401721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-70d466ad-1712-485c-91a2-bfb4aaa32483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:42.471288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 575/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:42.495411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad73992-3bcc-491b-8a10-649f6de8a5bd None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:42.599028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad73992-3bcc-491b-8a10-649f6de8a5bd None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:42.633073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80087528-df6f-4f31-8dba-d26bc303c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:42.633786 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80087528-df6f-4f31-8dba-d26bc303c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:42.634101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80087528-df6f-4f31-8dba-d26bc303c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:42.634372 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80087528-df6f-4f31-8dba-d26bc303c0d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:42.644740 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80087528-df6f-4f31-8dba-d26bc303c0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:41:42.651702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-80087528-df6f-4f31-8dba-d26bc303c0d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:41:42.652882 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 574/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:42.659240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d466ad-1712-485c-91a2-bfb4aaa32483 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:42.754266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d466ad-1712-485c-91a2-bfb4aaa32483 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:42.788505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b15fd-0482-4208-ba28-0c0b5846ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:42.789159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b15fd-0482-4208-ba28-0c0b5846ef13 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:42.789435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b15fd-0482-4208-ba28-0c0b5846ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:42.789708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b15fd-0482-4208-ba28-0c0b5846ef13 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:42.790455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b15fd-0482-4208-ba28-0c0b5846ef13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:42.790746 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b15fd-0482-4208-ba28-0c0b5846ef13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:42.792116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b15fd-0482-4208-ba28-0c0b5846ef13 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:42.800131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 576/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:42.806754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80087528-df6f-4f31-8dba-d26bc303c0d9 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:42.908004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80087528-df6f-4f31-8dba-d26bc303c0d9 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:42.942033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c4e4-440d-44bc-ac08-d69bc6f6f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:42.942952 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c4e4-440d-44bc-ac08-d69bc6f6f280 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:42.943230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c4e4-440d-44bc-ac08-d69bc6f6f280 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:42.943503 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c4e4-440d-44bc-ac08-d69bc6f6f280 None admin] PATH_INFO: `/v3/users/1cfeeb838041419094f80c86c3e49101` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:42.944748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42c4e4-440d-44bc-ac08-d69bc6f6f280 None admin] RBAC: Authorizing `identity:get_user(user_id=1cfeeb838041419094f80c86c3e49101)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:42.946217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42c4e4-440d-44bc-ac08-d69bc6f6f280 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:42.947845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 575/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:42 2022] GET /identity/v3/users/1cfeeb838041419094f80c86c3e49101 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:42.953961 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b15fd-0482-4208-ba28-0c0b5846ef13 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:43.057975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b15fd-0482-4208-ba28-0c0b5846ef13 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:43.093683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b3f52-16f2-463f-8efd-06aa1a5c3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:43.094599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b3f52-16f2-463f-8efd-06aa1a5c3154 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:43.094879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b3f52-16f2-463f-8efd-06aa1a5c3154 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:43.095153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b3f52-16f2-463f-8efd-06aa1a5c3154 None admin] PATH_INFO: `/v3/projects/cdf5d91a4db349e8885de8944728c553` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:43.096379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b3f52-16f2-463f-8efd-06aa1a5c3154 None admin] RBAC: Authorizing `identity:get_project(project_id=cdf5d91a4db349e8885de8944728c553)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:43.098170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b3f52-16f2-463f-8efd-06aa1a5c3154 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:43.100034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 577/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:41:42 2022] GET /identity/v3/projects/cdf5d91a4db349e8885de8944728c553 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:43.106220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c4e4-440d-44bc-ac08-d69bc6f6f280 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:43.208153 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c4e4-440d-44bc-ac08-d69bc6f6f280 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:43.248793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132a1d7-cd93-4778-b354-6ea4ad8997db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:43.250217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132a1d7-cd93-4778-b354-6ea4ad8997db None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:43.250501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132a1d7-cd93-4778-b354-6ea4ad8997db None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:43.250779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132a1d7-cd93-4778-b354-6ea4ad8997db None admin] PATH_INFO: `/v3/projects/cdf5d91a4db349e8885de8944728c553/users/1cfeeb838041419094f80c86c3e49101/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:43.252848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132a1d7-cd93-4778-b354-6ea4ad8997db None admin] RBAC: Authorizing `identity:create_grant(project_id=cdf5d91a4db349e8885de8944728c553, user_id=1cfeeb838041419094f80c86c3e49101, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:43.254313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132a1d7-cd93-4778-b354-6ea4ad8997db None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:43.268448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 576/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:41:43 2022] PUT /identity/v3/projects/cdf5d91a4db349e8885de8944728c553/users/1cfeeb838041419094f80c86c3e49101/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:41:45.551768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148fd92-f06d-46e7-9b4e-2e959b71b6a7 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:45.552394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148fd92-f06d-46e7-9b4e-2e959b71b6a7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:45.552394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148fd92-f06d-46e7-9b4e-2e959b71b6a7 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:45.554153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 578/1154] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:45.559522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee0691-55b2-4ab1-83b1-f78fa9df3a81 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:45.559968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee0691-55b2-4ab1-83b1-f78fa9df3a81 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:45.560057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee0691-55b2-4ab1-83b1-f78fa9df3a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:45.577645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9fee0691-55b2-4ab1-83b1-f78fa9df3a81 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:45.578872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9fee0691-55b2-4ab1-83b1-f78fa9df3a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:45.650112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 577/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:45.673833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148fd92-f06d-46e7-9b4e-2e959b71b6a7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:45.778515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148fd92-f06d-46e7-9b4e-2e959b71b6a7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:45.812395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35a7eb-c1d2-4389-ad4d-9a7b5e4dd240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:45.813234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a7eb-c1d2-4389-ad4d-9a7b5e4dd240 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:45.813515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a7eb-c1d2-4389-ad4d-9a7b5e4dd240 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:45.813793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a7eb-c1d2-4389-ad4d-9a7b5e4dd240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:45.823951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35a7eb-c1d2-4389-ad4d-9a7b5e4dd240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:41:45.830836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-fd35a7eb-c1d2-4389-ad4d-9a7b5e4dd240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:41:45.832031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 579/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:41:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:45.838311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee0691-55b2-4ab1-83b1-f78fa9df3a81 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:45.936645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee0691-55b2-4ab1-83b1-f78fa9df3a81 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:45.970215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc891def-f6e0-4bda-8792-26ed449d2a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:45.970870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc891def-f6e0-4bda-8792-26ed449d2a19 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:45.971147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc891def-f6e0-4bda-8792-26ed449d2a19 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:45.971414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc891def-f6e0-4bda-8792-26ed449d2a19 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:45.972155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc891def-f6e0-4bda-8792-26ed449d2a19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:45.972452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc891def-f6e0-4bda-8792-26ed449d2a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:45.974168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc891def-f6e0-4bda-8792-26ed449d2a19 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:45.982238 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 578/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:41:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:45.988273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35a7eb-c1d2-4389-ad4d-9a7b5e4dd240 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:46.089725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35a7eb-c1d2-4389-ad4d-9a7b5e4dd240 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:46.124174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf906b58-3f43-4e36-925b-78bdb37b2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:46.125028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf906b58-3f43-4e36-925b-78bdb37b2d77 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:46.125303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf906b58-3f43-4e36-925b-78bdb37b2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:46.125569 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf906b58-3f43-4e36-925b-78bdb37b2d77 None admin] PATH_INFO: `/v3/users/1cfeeb838041419094f80c86c3e49101` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:46.126815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf906b58-3f43-4e36-925b-78bdb37b2d77 None admin] RBAC: Authorizing `identity:get_user(user_id=1cfeeb838041419094f80c86c3e49101)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:46.128218 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf906b58-3f43-4e36-925b-78bdb37b2d77 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:46.130051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 580/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:41:45 2022] GET /identity/v3/users/1cfeeb838041419094f80c86c3e49101 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:46.135921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc891def-f6e0-4bda-8792-26ed449d2a19 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:46.235947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc891def-f6e0-4bda-8792-26ed449d2a19 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:46.268549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78824a0-f7dc-4b04-b5e0-c473f1232846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:46.269258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78824a0-f7dc-4b04-b5e0-c473f1232846 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:46.269483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78824a0-f7dc-4b04-b5e0-c473f1232846 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:46.269739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78824a0-f7dc-4b04-b5e0-c473f1232846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:46.336783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78824a0-f7dc-4b04-b5e0-c473f1232846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:46.338261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78824a0-f7dc-4b04-b5e0-c473f1232846 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:46.436305 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 579/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:41:46.442499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf906b58-3f43-4e36-925b-78bdb37b2d77 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:46.544213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf906b58-3f43-4e36-925b-78bdb37b2d77 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:46.578209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0faa8a-6646-4247-a561-b86cf19f34d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:46.579062 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0faa8a-6646-4247-a561-b86cf19f34d9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:46.579342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0faa8a-6646-4247-a561-b86cf19f34d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:46.579596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0faa8a-6646-4247-a561-b86cf19f34d9 None admin] PATH_INFO: `/v3/projects/cdf5d91a4db349e8885de8944728c553` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:46.580798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0faa8a-6646-4247-a561-b86cf19f34d9 None admin] RBAC: Authorizing `identity:get_project(project_id=cdf5d91a4db349e8885de8944728c553)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:46.582311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0faa8a-6646-4247-a561-b86cf19f34d9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:46.584105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 581/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:41:46 2022] GET /identity/v3/projects/cdf5d91a4db349e8885de8944728c553 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:46.590657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78824a0-f7dc-4b04-b5e0-c473f1232846 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:46.688640 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78824a0-f7dc-4b04-b5e0-c473f1232846 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:46.722277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18758386-a59b-47e1-8be8-74daf6ce9e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:46.723229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758386-a59b-47e1-8be8-74daf6ce9e34 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:46.723586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758386-a59b-47e1-8be8-74daf6ce9e34 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:46.724021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18758386-a59b-47e1-8be8-74daf6ce9e34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:46.724844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18758386-a59b-47e1-8be8-74daf6ce9e34 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=cdf5d91a4db349e8885de8944728c553, user.id=1cfeeb838041419094f80c86c3e49101) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:46.725158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18758386-a59b-47e1-8be8-74daf6ce9e34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:46.726618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18758386-a59b-47e1-8be8-74daf6ce9e34 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:46.733631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 580/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:41:46 2022] GET /identity/v3/role_assignments?user.id=1cfeeb838041419094f80c86c3e49101&scope.project.id=cdf5d91a4db349e8885de8944728c553&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:49.066224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418870a-fd96-40ba-a515-01f59e72eb76 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:49.066777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418870a-fd96-40ba-a515-01f59e72eb76 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:49.066777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418870a-fd96-40ba-a515-01f59e72eb76 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:49.069202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 582/1162] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:49.076635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39633a05-9f0c-4cd1-9165-7993f464fd0b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:49.077160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39633a05-9f0c-4cd1-9165-7993f464fd0b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:49.077304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39633a05-9f0c-4cd1-9165-7993f464fd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:49.107120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-39633a05-9f0c-4cd1-9165-7993f464fd0b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:49.108201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-39633a05-9f0c-4cd1-9165-7993f464fd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:49.180400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 581/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:41:49.203928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418870a-fd96-40ba-a515-01f59e72eb76 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:49.314152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418870a-fd96-40ba-a515-01f59e72eb76 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:49.352351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae052af6-9117-4cae-a5b2-c08f1bfcf1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:49.353018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae052af6-9117-4cae-a5b2-c08f1bfcf1b4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:49.353302 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae052af6-9117-4cae-a5b2-c08f1bfcf1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:49.353581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae052af6-9117-4cae-a5b2-c08f1bfcf1b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:49.420786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae052af6-9117-4cae-a5b2-c08f1bfcf1b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:49.422194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae052af6-9117-4cae-a5b2-c08f1bfcf1b4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:49.525886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 583/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:41:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:41:49.532066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39633a05-9f0c-4cd1-9165-7993f464fd0b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:49.636169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39633a05-9f0c-4cd1-9165-7993f464fd0b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:49.671398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e043f-70be-40e2-831b-5fd0aa52ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:49.672096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e043f-70be-40e2-831b-5fd0aa52ef03 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:49.672383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e043f-70be-40e2-831b-5fd0aa52ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:49.672655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e043f-70be-40e2-831b-5fd0aa52ef03 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:49.679689 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e043f-70be-40e2-831b-5fd0aa52ef03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:49.681123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e043f-70be-40e2-831b-5fd0aa52ef03 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:49.694542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-829e043f-70be-40e2-831b-5fd0aa52ef03 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 22 19:41:49.695704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 582/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:41:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:41:49.701932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae052af6-9117-4cae-a5b2-c08f1bfcf1b4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:49.803617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae052af6-9117-4cae-a5b2-c08f1bfcf1b4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:49.841084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375b807-02f3-48e2-8269-33b3f5881141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:49.841756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b807-02f3-48e2-8269-33b3f5881141 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:49.842064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b807-02f3-48e2-8269-33b3f5881141 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:49.842342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375b807-02f3-48e2-8269-33b3f5881141 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:49.843066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375b807-02f3-48e2-8269-33b3f5881141 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:41:49.843374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375b807-02f3-48e2-8269-33b3f5881141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:49.844756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375b807-02f3-48e2-8269-33b3f5881141 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:49.852463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 584/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Mar 22 19:41:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:52.146179 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd1893-f79d-44d3-9242-99b8b4d1e871 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:52.146778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd1893-f79d-44d3-9242-99b8b4d1e871 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:52.146778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd1893-f79d-44d3-9242-99b8b4d1e871 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:52.148453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 583/1167] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:52.154156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436297b-2a01-4a09-b6c7-a654be1ee501 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:52.154632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436297b-2a01-4a09-b6c7-a654be1ee501 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:52.154731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436297b-2a01-4a09-b6c7-a654be1ee501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:52.174179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-3436297b-2a01-4a09-b6c7-a654be1ee501 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:52.175395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3436297b-2a01-4a09-b6c7-a654be1ee501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:52.258882 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 585/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:52.284304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd1893-f79d-44d3-9242-99b8b4d1e871 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:52.400582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd1893-f79d-44d3-9242-99b8b4d1e871 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:52.446735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573d0f0-050c-419f-a6a7-ae24c42407c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:52.447536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573d0f0-050c-419f-a6a7-ae24c42407c8 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:52.447841 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573d0f0-050c-419f-a6a7-ae24c42407c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:52.448114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573d0f0-050c-419f-a6a7-ae24c42407c8 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:52.449040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573d0f0-050c-419f-a6a7-ae24c42407c8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:52.450482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573d0f0-050c-419f-a6a7-ae24c42407c8 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:52.468835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 584/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Tue Mar 22 19:41:52 2022] POST /identity/v3/domains => generated 267 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:41:55.172367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31501-e134-4f68-ab1c-01d0efcbac7d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:55.172910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31501-e134-4f68-ab1c-01d0efcbac7d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:55.172910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31501-e134-4f68-ab1c-01d0efcbac7d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:55.174608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 586/1170] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:55.180356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8786604-abe0-4076-abd4-345c0ae96a85 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:55.180845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8786604-abe0-4076-abd4-345c0ae96a85 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:55.180947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8786604-abe0-4076-abd4-345c0ae96a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:55.199373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-e8786604-abe0-4076-abd4-345c0ae96a85 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:55.200567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e8786604-abe0-4076-abd4-345c0ae96a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:55.274895 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 585/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:55.299018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31501-e134-4f68-ab1c-01d0efcbac7d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:55.408917 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31501-e134-4f68-ab1c-01d0efcbac7d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:55.446286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6129f0-a70c-411e-a9bd-993923a10cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:55.447046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6129f0-a70c-411e-a9bd-993923a10cb0 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:55.447334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6129f0-a70c-411e-a9bd-993923a10cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:55.447603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6129f0-a70c-411e-a9bd-993923a10cb0 None admin] PATH_INFO: `/v3/domains/6edd703dc11142888a67bd3cecac2192` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:55.459042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6129f0-a70c-411e-a9bd-993923a10cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6edd703dc11142888a67bd3cecac2192)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:55.460493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6129f0-a70c-411e-a9bd-993923a10cb0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:55.462236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 587/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Tue Mar 22 19:41:55 2022] GET /identity/v3/domains/6edd703dc11142888a67bd3cecac2192 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:55.468556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8786604-abe0-4076-abd4-345c0ae96a85 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:55.586210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8786604-abe0-4076-abd4-345c0ae96a85 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:55.623126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654ab29-b423-4ff0-9033-de79b905d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:55.623769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654ab29-b423-4ff0-9033-de79b905d967 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:55.624046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654ab29-b423-4ff0-9033-de79b905d967 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:55.624314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654ab29-b423-4ff0-9033-de79b905d967 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:55.625005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654ab29-b423-4ff0-9033-de79b905d967 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:55.626465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654ab29-b423-4ff0-9033-de79b905d967 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:55.657370 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 586/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:41:55 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:41:58.187669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de6a05-e50c-49e1-835a-f3ea6bbe2997 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:58.188184 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de6a05-e50c-49e1-835a-f3ea6bbe2997 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:58.188293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de6a05-e50c-49e1-835a-f3ea6bbe2997 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:58.190246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 588/1174] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:41:58.198437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6af9f-56f5-49ac-b9d8-e31abebbcfe7 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:58.199298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6af9f-56f5-49ac-b9d8-e31abebbcfe7 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:58.199576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6af9f-56f5-49ac-b9d8-e31abebbcfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:58.217457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1bb6af9f-56f5-49ac-b9d8-e31abebbcfe7 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:41:58.218699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1bb6af9f-56f5-49ac-b9d8-e31abebbcfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:41:58.300578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 587/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:41:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:41:58.330445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de6a05-e50c-49e1-835a-f3ea6bbe2997 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:58.456363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de6a05-e50c-49e1-835a-f3ea6bbe2997 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:58.497693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486b623-4d56-4c0c-a979-ead0a3b40f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:58.498589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b623-4d56-4c0c-a979-ead0a3b40f4b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:58.498861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b623-4d56-4c0c-a979-ead0a3b40f4b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:58.499136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b623-4d56-4c0c-a979-ead0a3b40f4b None admin] PATH_INFO: `/v3/domains/6edd703dc11142888a67bd3cecac2192` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:58.500350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486b623-4d56-4c0c-a979-ead0a3b40f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=6edd703dc11142888a67bd3cecac2192)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:58.501789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486b623-4d56-4c0c-a979-ead0a3b40f4b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:58.503442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 589/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Tue Mar 22 19:41:58 2022] GET /identity/v3/domains/6edd703dc11142888a67bd3cecac2192 => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:41:58.509786 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6af9f-56f5-49ac-b9d8-e31abebbcfe7 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:41:58.606752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6af9f-56f5-49ac-b9d8-e31abebbcfe7 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:41:58.640552 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee32ea-81b4-4552-a70b-a9eb92586734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:41:58.641242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee32ea-81b4-4552-a70b-a9eb92586734 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:41:58.641515 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee32ea-81b4-4552-a70b-a9eb92586734 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:41:58.641784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee32ea-81b4-4552-a70b-a9eb92586734 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:41:58.642516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee32ea-81b4-4552-a70b-a9eb92586734 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:41:58.644088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee32ea-81b4-4552-a70b-a9eb92586734 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:41:58.664969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 588/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:41:58 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:42:01.092828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96b50-de61-4056-ac5a-07c736ab1b9d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:01.093351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96b50-de61-4056-ac5a-07c736ab1b9d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:01.093351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96b50-de61-4056-ac5a-07c736ab1b9d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:01.095058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 590/1178] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:42:01.101673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2ccb9-eff7-48f1-8b02-67527052ab76 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:01.102118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2ccb9-eff7-48f1-8b02-67527052ab76 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:01.102251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2ccb9-eff7-48f1-8b02-67527052ab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:01.120099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1ca2ccb9-eff7-48f1-8b02-67527052ab76 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:42:01.121282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1ca2ccb9-eff7-48f1-8b02-67527052ab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:42:01.187157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 589/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:42:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:42:01.213550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96b50-de61-4056-ac5a-07c736ab1b9d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:01.315653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96b50-de61-4056-ac5a-07c736ab1b9d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:01.350830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae02ca-a70f-4971-841c-f67427846b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:01.351540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae02ca-a70f-4971-841c-f67427846b83 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:01.351816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae02ca-a70f-4971-841c-f67427846b83 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:01.352097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae02ca-a70f-4971-841c-f67427846b83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:01.362867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae02ca-a70f-4971-841c-f67427846b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:42:01.369663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b3ae02ca-a70f-4971-841c-f67427846b83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:42:01.370884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 591/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:42:01.377269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2ccb9-eff7-48f1-8b02-67527052ab76 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:01.477534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2ccb9-eff7-48f1-8b02-67527052ab76 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:01.512099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab460df-ffb5-4425-91ba-c214260453bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:01.512753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab460df-ffb5-4425-91ba-c214260453bd None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:01.513053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab460df-ffb5-4425-91ba-c214260453bd None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:01.513321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab460df-ffb5-4425-91ba-c214260453bd None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:01.514094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab460df-ffb5-4425-91ba-c214260453bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:42:01.514396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab460df-ffb5-4425-91ba-c214260453bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:01.515757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab460df-ffb5-4425-91ba-c214260453bd None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:01.524813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 590/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:42:01.531043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae02ca-a70f-4971-841c-f67427846b83 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:01.639054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae02ca-a70f-4971-841c-f67427846b83 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:01.673870 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b40042-f2de-423a-b926-4645879a2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:01.674784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40042-f2de-423a-b926-4645879a2023 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:01.675060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40042-f2de-423a-b926-4645879a2023 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:01.675326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40042-f2de-423a-b926-4645879a2023 None admin] PATH_INFO: `/v3/users/9a28870cddff4de382b8ec08068e17f2` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:01.689579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b40042-f2de-423a-b926-4645879a2023 None admin] RBAC: Authorizing `identity:get_user(user_id=9a28870cddff4de382b8ec08068e17f2)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:01.691069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b40042-f2de-423a-b926-4645879a2023 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:01.693343 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 592/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:42:01 2022] GET /identity/v3/users/9a28870cddff4de382b8ec08068e17f2 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:42:01.699465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab460df-ffb5-4425-91ba-c214260453bd None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:01.798242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab460df-ffb5-4425-91ba-c214260453bd None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:01.833236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1c5e-d665-4167-ae2c-75e0bdb3109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:01.833927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1c5e-d665-4167-ae2c-75e0bdb3109b None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:01.834162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1c5e-d665-4167-ae2c-75e0bdb3109b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:01.834674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1c5e-d665-4167-ae2c-75e0bdb3109b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:01.905522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b1c5e-d665-4167-ae2c-75e0bdb3109b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:01.906950 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b1c5e-d665-4167-ae2c-75e0bdb3109b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:02.020427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 591/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:42:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 22 19:42:02.027770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b40042-f2de-423a-b926-4645879a2023 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:02.126512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b40042-f2de-423a-b926-4645879a2023 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:02.159696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0d7b-2244-42c0-8702-3c7289b3fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:02.160470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0d7b-2244-42c0-8702-3c7289b3fc60 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:02.160756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0d7b-2244-42c0-8702-3c7289b3fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:02.161020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0d7b-2244-42c0-8702-3c7289b3fc60 None admin] PATH_INFO: `/v3/projects/f6cab19dd46a48979ef5196ebbdc6f8c` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:02.162293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a0d7b-2244-42c0-8702-3c7289b3fc60 None admin] RBAC: Authorizing `identity:get_project(project_id=f6cab19dd46a48979ef5196ebbdc6f8c)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:02.163761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a0d7b-2244-42c0-8702-3c7289b3fc60 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:02.165436 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 593/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:42:02 2022] GET /identity/v3/projects/f6cab19dd46a48979ef5196ebbdc6f8c => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:42:02.172284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1c5e-d665-4167-ae2c-75e0bdb3109b None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:02.266746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1c5e-d665-4167-ae2c-75e0bdb3109b None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:02.300805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9687be-a90b-4157-b6e8-0f28365cf7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:02.301627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9687be-a90b-4157-b6e8-0f28365cf7ea None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:02.301885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9687be-a90b-4157-b6e8-0f28365cf7ea None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:02.302226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9687be-a90b-4157-b6e8-0f28365cf7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:02.303047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9687be-a90b-4157-b6e8-0f28365cf7ea None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=f6cab19dd46a48979ef5196ebbdc6f8c, user.id=9a28870cddff4de382b8ec08068e17f2) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:42:02.303371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9687be-a90b-4157-b6e8-0f28365cf7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:02.304807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9687be-a90b-4157-b6e8-0f28365cf7ea None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:02.310494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 592/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:42:02 2022] GET /identity/v3/role_assignments?user.id=9a28870cddff4de382b8ec08068e17f2&scope.project.id=f6cab19dd46a48979ef5196ebbdc6f8c&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:42:04.753372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26f25-ccef-4f9a-b90e-a26ac288cf17 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:04.753909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26f25-ccef-4f9a-b90e-a26ac288cf17 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:04.753909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26f25-ccef-4f9a-b90e-a26ac288cf17 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:04.755741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 594/1186] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:42:04.761795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a411b-3bed-4508-bad9-91906af828a1 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:04.762213 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a411b-3bed-4508-bad9-91906af828a1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:04.762475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a411b-3bed-4508-bad9-91906af828a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:04.782207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3d1a411b-3bed-4508-bad9-91906af828a1 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:42:04.783536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3d1a411b-3bed-4508-bad9-91906af828a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:42:04.855015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 593/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:42:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:42:04.880212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d26f25-ccef-4f9a-b90e-a26ac288cf17 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:04.986505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d26f25-ccef-4f9a-b90e-a26ac288cf17 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:05.026347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf49a3-0f44-4720-a66e-051f49e5be88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:05.027050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf49a3-0f44-4720-a66e-051f49e5be88 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:05.027365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf49a3-0f44-4720-a66e-051f49e5be88 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:05.027636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf49a3-0f44-4720-a66e-051f49e5be88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:05.039267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf49a3-0f44-4720-a66e-051f49e5be88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:42:05.046056 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-18cf49a3-0f44-4720-a66e-051f49e5be88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:42:05.047288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 595/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:42:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:42:05.053717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a411b-3bed-4508-bad9-91906af828a1 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:05.155067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a411b-3bed-4508-bad9-91906af828a1 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:05.193310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2ec31-cd00-4d50-a866-e8559895605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:05.194058 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2ec31-cd00-4d50-a866-e8559895605d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:05.194366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2ec31-cd00-4d50-a866-e8559895605d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:05.194651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2ec31-cd00-4d50-a866-e8559895605d None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:05.195481 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2ec31-cd00-4d50-a866-e8559895605d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:42:05.195814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2ec31-cd00-4d50-a866-e8559895605d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:05.197356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2ec31-cd00-4d50-a866-e8559895605d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:05.206639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 594/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:42:05.213233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf49a3-0f44-4720-a66e-051f49e5be88 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:05.315923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf49a3-0f44-4720-a66e-051f49e5be88 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:05.349750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c7e0f-e227-4472-991a-bc7533247cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:05.350723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7e0f-e227-4472-991a-bc7533247cdc None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:05.351004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7e0f-e227-4472-991a-bc7533247cdc None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:05.351278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7e0f-e227-4472-991a-bc7533247cdc None admin] PATH_INFO: `/v3/users/9a28870cddff4de382b8ec08068e17f2` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:05.352482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c7e0f-e227-4472-991a-bc7533247cdc None admin] RBAC: Authorizing `identity:get_user(user_id=9a28870cddff4de382b8ec08068e17f2)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:05.353919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c7e0f-e227-4472-991a-bc7533247cdc None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:05.355592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 596/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:42:05 2022] GET /identity/v3/users/9a28870cddff4de382b8ec08068e17f2 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:42:05.361699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2ec31-cd00-4d50-a866-e8559895605d None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:05.461273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2ec31-cd00-4d50-a866-e8559895605d None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:05.494157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913582c-cafb-4f21-89b9-1d90afc87a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:05.495050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913582c-cafb-4f21-89b9-1d90afc87a57 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:05.495338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913582c-cafb-4f21-89b9-1d90afc87a57 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:05.495606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913582c-cafb-4f21-89b9-1d90afc87a57 None admin] PATH_INFO: `/v3/projects/f6cab19dd46a48979ef5196ebbdc6f8c` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:05.496843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913582c-cafb-4f21-89b9-1d90afc87a57 None admin] RBAC: Authorizing `identity:get_project(project_id=f6cab19dd46a48979ef5196ebbdc6f8c)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:05.498340 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913582c-cafb-4f21-89b9-1d90afc87a57 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:05.500112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 595/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:42:05 2022] GET /identity/v3/projects/f6cab19dd46a48979ef5196ebbdc6f8c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:42:05.506638 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c7e0f-e227-4472-991a-bc7533247cdc None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:05.612646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c7e0f-e227-4472-991a-bc7533247cdc None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:05.644063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029990c-3196-4a53-8cd0-3a7496fa285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:05.645052 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029990c-3196-4a53-8cd0-3a7496fa285b None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:05.645421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029990c-3196-4a53-8cd0-3a7496fa285b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:05.645700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029990c-3196-4a53-8cd0-3a7496fa285b None admin] PATH_INFO: `/v3/projects/f6cab19dd46a48979ef5196ebbdc6f8c/users/9a28870cddff4de382b8ec08068e17f2/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:05.647688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029990c-3196-4a53-8cd0-3a7496fa285b None admin] RBAC: Authorizing `identity:create_grant(project_id=f6cab19dd46a48979ef5196ebbdc6f8c, user_id=9a28870cddff4de382b8ec08068e17f2, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:05.649171 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029990c-3196-4a53-8cd0-3a7496fa285b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:05.663597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 597/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:42:05 2022] PUT /identity/v3/projects/f6cab19dd46a48979ef5196ebbdc6f8c/users/9a28870cddff4de382b8ec08068e17f2/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:42:08.015955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd27f6b-4a4d-4a06-86fd-7b6bba19a7d0 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:08.016585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd27f6b-4a4d-4a06-86fd-7b6bba19a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:08.016585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd27f6b-4a4d-4a06-86fd-7b6bba19a7d0 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:08.018397 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 596/1193] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:42:08.024924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bd3a-f135-4b66-8709-a8e04229b0b2 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:08.025401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bd3a-f135-4b66-8709-a8e04229b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:08.025498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bd3a-f135-4b66-8709-a8e04229b0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:08.045846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-abc0bd3a-f135-4b66-8709-a8e04229b0b2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:42:08.047127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-abc0bd3a-f135-4b66-8709-a8e04229b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:42:08.118402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 598/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:42:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:42:08.142968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd27f6b-4a4d-4a06-86fd-7b6bba19a7d0 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:08.245323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd27f6b-4a4d-4a06-86fd-7b6bba19a7d0 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:08.280204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcb423-8c49-4a92-9ff5-9e290dfef3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:08.281063 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcb423-8c49-4a92-9ff5-9e290dfef3e6 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:08.281526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcb423-8c49-4a92-9ff5-9e290dfef3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:08.281807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcb423-8c49-4a92-9ff5-9e290dfef3e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:08.293269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fcb423-8c49-4a92-9ff5-9e290dfef3e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:42:08.300223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-14fcb423-8c49-4a92-9ff5-9e290dfef3e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:42:08.301616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 597/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:42:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:42:08.308188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bd3a-f135-4b66-8709-a8e04229b0b2 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:08.415960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bd3a-f135-4b66-8709-a8e04229b0b2 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:08.451037 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f23dec-9315-4c85-b205-f36207343010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:08.451737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23dec-9315-4c85-b205-f36207343010 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:08.452012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23dec-9315-4c85-b205-f36207343010 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:08.452282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23dec-9315-4c85-b205-f36207343010 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:08.453025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f23dec-9315-4c85-b205-f36207343010 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:42:08.453324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f23dec-9315-4c85-b205-f36207343010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:08.454896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f23dec-9315-4c85-b205-f36207343010 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:08.463876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 599/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:42:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:42:08.470190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcb423-8c49-4a92-9ff5-9e290dfef3e6 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:08.574273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcb423-8c49-4a92-9ff5-9e290dfef3e6 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:08.608891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b0489-4638-4256-98c3-6137656f53b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:08.609792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b0489-4638-4256-98c3-6137656f53b1 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:08.610102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b0489-4638-4256-98c3-6137656f53b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:08.610379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b0489-4638-4256-98c3-6137656f53b1 None admin] PATH_INFO: `/v3/users/9a28870cddff4de382b8ec08068e17f2` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:08.611586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b0489-4638-4256-98c3-6137656f53b1 None admin] RBAC: Authorizing `identity:get_user(user_id=9a28870cddff4de382b8ec08068e17f2)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:08.613028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b0489-4638-4256-98c3-6137656f53b1 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:08.615036 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 598/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Mar 22 19:42:08 2022] GET /identity/v3/users/9a28870cddff4de382b8ec08068e17f2 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:42:08.621213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f23dec-9315-4c85-b205-f36207343010 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:08.723837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f23dec-9315-4c85-b205-f36207343010 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:08.758377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed41b3-5e34-422b-b1e2-8f51dad81d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:08.759032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed41b3-5e34-422b-b1e2-8f51dad81d6a None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:08.759311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed41b3-5e34-422b-b1e2-8f51dad81d6a None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:08.759576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed41b3-5e34-422b-b1e2-8f51dad81d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:08.827667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed41b3-5e34-422b-b1e2-8f51dad81d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:08.829144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed41b3-5e34-422b-b1e2-8f51dad81d6a None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:08.930573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 600/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:42:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:42:08.936756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b0489-4638-4256-98c3-6137656f53b1 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:09.041223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b0489-4638-4256-98c3-6137656f53b1 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:09.077545 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535a795-e5a9-47d9-a4dd-4207c678224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:09.078442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535a795-e5a9-47d9-a4dd-4207c678224f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:09.078721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535a795-e5a9-47d9-a4dd-4207c678224f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:09.078999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535a795-e5a9-47d9-a4dd-4207c678224f None admin] PATH_INFO: `/v3/projects/f6cab19dd46a48979ef5196ebbdc6f8c` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:09.080264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535a795-e5a9-47d9-a4dd-4207c678224f None admin] RBAC: Authorizing `identity:get_project(project_id=f6cab19dd46a48979ef5196ebbdc6f8c)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:09.081723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535a795-e5a9-47d9-a4dd-4207c678224f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:09.084245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 599/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Mar 22 19:42:08 2022] GET /identity/v3/projects/f6cab19dd46a48979ef5196ebbdc6f8c => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:42:09.091305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed41b3-5e34-422b-b1e2-8f51dad81d6a None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:42:09.194254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed41b3-5e34-422b-b1e2-8f51dad81d6a None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:42:09.228555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96656d0a-4674-4d6e-8615-0b7cb86a13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:42:09.229226 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96656d0a-4674-4d6e-8615-0b7cb86a13a1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:42:09.229476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96656d0a-4674-4d6e-8615-0b7cb86a13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:42:09.229782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96656d0a-4674-4d6e-8615-0b7cb86a13a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:42:09.230664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96656d0a-4674-4d6e-8615-0b7cb86a13a1 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=f6cab19dd46a48979ef5196ebbdc6f8c, user.id=9a28870cddff4de382b8ec08068e17f2) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:42:09.230976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96656d0a-4674-4d6e-8615-0b7cb86a13a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:42:09.232463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96656d0a-4674-4d6e-8615-0b7cb86a13a1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:42:09.238455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 601/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:42:09 2022] GET /identity/v3/role_assignments?user.id=9a28870cddff4de382b8ec08068e17f2&scope.project.id=f6cab19dd46a48979ef5196ebbdc6f8c&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:14.543294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153eb92-cd98-4e35-8d84-af93491a22d5 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:14.543982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153eb92-cd98-4e35-8d84-af93491a22d5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:14.543982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153eb92-cd98-4e35-8d84-af93491a22d5 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:14.549749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 600/1201] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:14.554195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e54e-c65c-4ee0-86a9-8d39133cab1e None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:14.554195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e54e-c65c-4ee0-86a9-8d39133cab1e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:14.554195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e54e-c65c-4ee0-86a9-8d39133cab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:14.571390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-9418e54e-c65c-4ee0-86a9-8d39133cab1e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:14.572603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9418e54e-c65c-4ee0-86a9-8d39133cab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:14.650395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 602/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:14.677196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153eb92-cd98-4e35-8d84-af93491a22d5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:14.827247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153eb92-cd98-4e35-8d84-af93491a22d5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:14.870267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06499f9-6d8f-49b1-87a4-f6309c698f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:14.871659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06499f9-6d8f-49b1-87a4-f6309c698f87 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:14.872140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06499f9-6d8f-49b1-87a4-f6309c698f87 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:14.872668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06499f9-6d8f-49b1-87a4-f6309c698f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:14.888629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06499f9-6d8f-49b1-87a4-f6309c698f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:14.890830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06499f9-6d8f-49b1-87a4-f6309c698f87 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:14.916877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-a06499f9-6d8f-49b1-87a4-f6309c698f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:14.918671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 601/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:14.927862 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e54e-c65c-4ee0-86a9-8d39133cab1e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:15.071203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e54e-c65c-4ee0-86a9-8d39133cab1e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:15.114826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fba440-118c-4465-ae6d-e403e75b89de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:15.115885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fba440-118c-4465-ae6d-e403e75b89de None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:15.116419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fba440-118c-4465-ae6d-e403e75b89de None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:15.116929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fba440-118c-4465-ae6d-e403e75b89de None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:15.117923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fba440-118c-4465-ae6d-e403e75b89de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:15.118533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fba440-118c-4465-ae6d-e403e75b89de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:15.120350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fba440-118c-4465-ae6d-e403e75b89de None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:15.134444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 603/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:15.140419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06499f9-6d8f-49b1-87a4-f6309c698f87 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:15.262438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06499f9-6d8f-49b1-87a4-f6309c698f87 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:15.309114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafe095-a0e7-4e51-a5f2-898373ad919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:15.309814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafe095-a0e7-4e51-a5f2-898373ad919a None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:15.310120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafe095-a0e7-4e51-a5f2-898373ad919a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:15.310395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafe095-a0e7-4e51-a5f2-898373ad919a None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:15.311134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafe095-a0e7-4e51-a5f2-898373ad919a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:15.312631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafe095-a0e7-4e51-a5f2-898373ad919a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:15.340736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 602/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Mar 22 19:43:15 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:43:18.042536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0afb6-6f40-44d3-9867-22e6b531ccac None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:18.043400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0afb6-6f40-44d3-9867-22e6b531ccac None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:18.043400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0afb6-6f40-44d3-9867-22e6b531ccac None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:18.045047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 604/1206] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:43:18.051584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7a54d-8365-49d8-bcd0-a0f76ea01e98 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:18.052105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7a54d-8365-49d8-bcd0-a0f76ea01e98 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:18.052105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7a54d-8365-49d8-bcd0-a0f76ea01e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:18.072817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c7a7a54d-8365-49d8-bcd0-a0f76ea01e98 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:18.074104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c7a7a54d-8365-49d8-bcd0-a0f76ea01e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:18.157722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 603/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:18.186378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0afb6-6f40-44d3-9867-22e6b531ccac None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:18.317721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0afb6-6f40-44d3-9867-22e6b531ccac None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:18.375211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715d58-5820-4410-912b-4b465026ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:18.376170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715d58-5820-4410-912b-4b465026ca00 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:18.376450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715d58-5820-4410-912b-4b465026ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:18.376724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715d58-5820-4410-912b-4b465026ca00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:18.390756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5715d58-5820-4410-912b-4b465026ca00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:43:18.399331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-b5715d58-5820-4410-912b-4b465026ca00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:43:18.406035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 605/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:43:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:18.408294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7a54d-8365-49d8-bcd0-a0f76ea01e98 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:18.539992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7a54d-8365-49d8-bcd0-a0f76ea01e98 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:18.579415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789464d8-9ed8-4cfa-965d-baa72e582ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:18.580466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789464d8-9ed8-4cfa-965d-baa72e582ec3 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:18.580759 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789464d8-9ed8-4cfa-965d-baa72e582ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:18.581028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789464d8-9ed8-4cfa-965d-baa72e582ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:18.581855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789464d8-9ed8-4cfa-965d-baa72e582ec3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:18.582316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789464d8-9ed8-4cfa-965d-baa72e582ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:18.583970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789464d8-9ed8-4cfa-965d-baa72e582ec3 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:18.601922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 604/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:43:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:18.603420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715d58-5820-4410-912b-4b465026ca00 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:18.733013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715d58-5820-4410-912b-4b465026ca00 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:18.773349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d209b39-88f4-49ee-a836-f8d10a021224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:18.775093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d209b39-88f4-49ee-a836-f8d10a021224 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:18.775093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d209b39-88f4-49ee-a836-f8d10a021224 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:18.775093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d209b39-88f4-49ee-a836-f8d10a021224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:18.788213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d209b39-88f4-49ee-a836-f8d10a021224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:18.789734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d209b39-88f4-49ee-a836-f8d10a021224 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:18.809014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-8d209b39-88f4-49ee-a836-f8d10a021224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:18.810660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 606/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:18.817394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789464d8-9ed8-4cfa-965d-baa72e582ec3 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:18.944412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789464d8-9ed8-4cfa-965d-baa72e582ec3 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:18.993766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cfa0b-f531-46f5-b3eb-3496a3d11a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:18.994419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cfa0b-f531-46f5-b3eb-3496a3d11a5f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:18.995693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cfa0b-f531-46f5-b3eb-3496a3d11a5f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:18.995693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cfa0b-f531-46f5-b3eb-3496a3d11a5f None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:18.996085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cfa0b-f531-46f5-b3eb-3496a3d11a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:18.996364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cfa0b-f531-46f5-b3eb-3496a3d11a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:18.997930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cfa0b-f531-46f5-b3eb-3496a3d11a5f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:19.011477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 605/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:19.017677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d209b39-88f4-49ee-a836-f8d10a021224 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:19.135821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d209b39-88f4-49ee-a836-f8d10a021224 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:19.175138 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49287a27-993f-4e7d-b098-d232d27feb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:19.175991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49287a27-993f-4e7d-b098-d232d27feb0f None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:19.176267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49287a27-993f-4e7d-b098-d232d27feb0f None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:19.176540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49287a27-993f-4e7d-b098-d232d27feb0f None admin] PATH_INFO: `/v3/users/placement` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:19.185209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49287a27-993f-4e7d-b098-d232d27feb0f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:19.186986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49287a27-993f-4e7d-b098-d232d27feb0f None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:19.202210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-49287a27-993f-4e7d-b098-d232d27feb0f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 22 19:43:19.203595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 607/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:19.210213 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cfa0b-f531-46f5-b3eb-3496a3d11a5f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:19.327666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cfa0b-f531-46f5-b3eb-3496a3d11a5f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:19.370346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ff6af-dce2-445b-8e12-00aaaed3606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:19.371263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff6af-dce2-445b-8e12-00aaaed3606e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:19.371533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff6af-dce2-445b-8e12-00aaaed3606e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:19.371804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff6af-dce2-445b-8e12-00aaaed3606e None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:19.372662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ff6af-dce2-445b-8e12-00aaaed3606e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:19.372976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ff6af-dce2-445b-8e12-00aaaed3606e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:19.374455 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ff6af-dce2-445b-8e12-00aaaed3606e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:19.401245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 606/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Mar 22 19:43:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:19.402930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49287a27-993f-4e7d-b098-d232d27feb0f None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:19.521551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49287a27-993f-4e7d-b098-d232d27feb0f None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:19.557624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b4a7c-f3cd-4052-9145-c4ce7dfb4c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:19.558597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b4a7c-f3cd-4052-9145-c4ce7dfb4c00 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:19.559040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b4a7c-f3cd-4052-9145-c4ce7dfb4c00 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:19.559520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b4a7c-f3cd-4052-9145-c4ce7dfb4c00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:19.637708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b4a7c-f3cd-4052-9145-c4ce7dfb4c00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:19.639453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b4a7c-f3cd-4052-9145-c4ce7dfb4c00 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:19.746826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 608/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:43:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:43:19.753140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ff6af-dce2-445b-8e12-00aaaed3606e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:19.863213 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ff6af-dce2-445b-8e12-00aaaed3606e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:19.902119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4f1af-76fd-4e7e-82e4-d81d74a93657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:19.903271 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4f1af-76fd-4e7e-82e4-d81d74a93657 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:19.903709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4f1af-76fd-4e7e-82e4-d81d74a93657 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:19.904128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4f1af-76fd-4e7e-82e4-d81d74a93657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:19.915787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4f1af-76fd-4e7e-82e4-d81d74a93657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:19.917787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4f1af-76fd-4e7e-82e4-d81d74a93657 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:19.937538 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-00f4f1af-76fd-4e7e-82e4-d81d74a93657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:19.939339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 607/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:19.946193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b4a7c-f3cd-4052-9145-c4ce7dfb4c00 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:20.068532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b4a7c-f3cd-4052-9145-c4ce7dfb4c00 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:20.111824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac3e8-ba44-4d10-9758-294985e85a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:20.112570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac3e8-ba44-4d10-9758-294985e85a0e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:20.112919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac3e8-ba44-4d10-9758-294985e85a0e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:20.113212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac3e8-ba44-4d10-9758-294985e85a0e None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:20.114040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ac3e8-ba44-4d10-9758-294985e85a0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:20.114348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ac3e8-ba44-4d10-9758-294985e85a0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:20.115852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ac3e8-ba44-4d10-9758-294985e85a0e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:20.128722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 609/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:20.134922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4f1af-76fd-4e7e-82e4-d81d74a93657 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:20.256887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4f1af-76fd-4e7e-82e4-d81d74a93657 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:20.300910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531cb7c-f983-4fd8-b862-c5fdeb0d6927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:20.301989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531cb7c-f983-4fd8-b862-c5fdeb0d6927 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:20.302451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531cb7c-f983-4fd8-b862-c5fdeb0d6927 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:20.302718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531cb7c-f983-4fd8-b862-c5fdeb0d6927 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:20.310804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531cb7c-f983-4fd8-b862-c5fdeb0d6927 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:20.313927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531cb7c-f983-4fd8-b862-c5fdeb0d6927 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:20.329370 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-4531cb7c-f983-4fd8-b862-c5fdeb0d6927 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:43:20.330694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 608/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:20.337156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac3e8-ba44-4d10-9758-294985e85a0e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:20.481549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac3e8-ba44-4d10-9758-294985e85a0e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:20.529243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61887e74-6d47-4097-b618-383ec586eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:20.530335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61887e74-6d47-4097-b618-383ec586eb55 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:20.530638 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61887e74-6d47-4097-b618-383ec586eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:20.531006 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61887e74-6d47-4097-b618-383ec586eb55 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:20.532117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61887e74-6d47-4097-b618-383ec586eb55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:20.532776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61887e74-6d47-4097-b618-383ec586eb55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:20.535003 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61887e74-6d47-4097-b618-383ec586eb55 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:20.550025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 610/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:20.557537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531cb7c-f983-4fd8-b862-c5fdeb0d6927 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:20.680928 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531cb7c-f983-4fd8-b862-c5fdeb0d6927 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:20.721149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479bb14-dd55-4a01-b935-1770d6af806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:20.722143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479bb14-dd55-4a01-b935-1770d6af806a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:20.722533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479bb14-dd55-4a01-b935-1770d6af806a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:20.722704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479bb14-dd55-4a01-b935-1770d6af806a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:20.723558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479bb14-dd55-4a01-b935-1770d6af806a None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=eed3ec40f28c4bc990d8f56466889aff) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:20.723862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479bb14-dd55-4a01-b935-1770d6af806a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:20.725386 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479bb14-dd55-4a01-b935-1770d6af806a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:20.732888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 609/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:43:20 2022] GET /identity/v3/role_assignments?user.id=eed3ec40f28c4bc990d8f56466889aff&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:23.273371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d842ac8-a1e9-4b00-8177-fb75bfc2f4c8 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:23.274255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d842ac8-a1e9-4b00-8177-fb75bfc2f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:23.274255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d842ac8-a1e9-4b00-8177-fb75bfc2f4c8 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:23.275714 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 611/1220] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:23.281198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d00544-a878-4f5b-a82c-01fac8cbf409 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:23.281695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d00544-a878-4f5b-a82c-01fac8cbf409 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:23.281811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d00544-a878-4f5b-a82c-01fac8cbf409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:23.300097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-f0d00544-a878-4f5b-a82c-01fac8cbf409 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:23.301303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f0d00544-a878-4f5b-a82c-01fac8cbf409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:23.379770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 610/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:23.405446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d842ac8-a1e9-4b00-8177-fb75bfc2f4c8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:23.526235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d842ac8-a1e9-4b00-8177-fb75bfc2f4c8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:23.571123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923fc2-8723-4183-8a07-c01ee2304fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:23.572543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923fc2-8723-4183-8a07-c01ee2304fa5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:23.572875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923fc2-8723-4183-8a07-c01ee2304fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:23.573297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923fc2-8723-4183-8a07-c01ee2304fa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:23.588189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e923fc2-8723-4183-8a07-c01ee2304fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:43:23.595511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-5e923fc2-8723-4183-8a07-c01ee2304fa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:43:23.597109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 612/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:43:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:23.603694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d00544-a878-4f5b-a82c-01fac8cbf409 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:23.719435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d00544-a878-4f5b-a82c-01fac8cbf409 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:23.759601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cb3d2-b9af-447a-b412-5a81c0d0a413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:23.760277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cb3d2-b9af-447a-b412-5a81c0d0a413 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:23.760593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cb3d2-b9af-447a-b412-5a81c0d0a413 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:23.760902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cb3d2-b9af-447a-b412-5a81c0d0a413 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:23.761694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cb3d2-b9af-447a-b412-5a81c0d0a413 None admin] RBAC: Adding query filter params (name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:23.762033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cb3d2-b9af-447a-b412-5a81c0d0a413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:23.763420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cb3d2-b9af-447a-b412-5a81c0d0a413 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:23.772651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 611/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:43:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:23.778654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923fc2-8723-4183-8a07-c01ee2304fa5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:23.892271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923fc2-8723-4183-8a07-c01ee2304fa5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:23.929663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bcbf0-b102-42ec-8461-ead391f8cf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:23.930617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bcbf0-b102-42ec-8461-ead391f8cf7c None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:23.930963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bcbf0-b102-42ec-8461-ead391f8cf7c None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:23.931238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bcbf0-b102-42ec-8461-ead391f8cf7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:23.943280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bcbf0-b102-42ec-8461-ead391f8cf7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:23.944933 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bcbf0-b102-42ec-8461-ead391f8cf7c None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:23.963346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-595bcbf0-b102-42ec-8461-ead391f8cf7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:23.964898 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 613/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:23.972426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cb3d2-b9af-447a-b412-5a81c0d0a413 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:24.085804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cb3d2-b9af-447a-b412-5a81c0d0a413 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:24.127283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27866-5073-4ba7-87e8-d9845b5cb478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:24.128158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27866-5073-4ba7-87e8-d9845b5cb478 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:24.128439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27866-5073-4ba7-87e8-d9845b5cb478 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:24.128736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27866-5073-4ba7-87e8-d9845b5cb478 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:24.129531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f27866-5073-4ba7-87e8-d9845b5cb478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:24.129881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f27866-5073-4ba7-87e8-d9845b5cb478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:24.131461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f27866-5073-4ba7-87e8-d9845b5cb478 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:24.145021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 612/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:24.150530 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bcbf0-b102-42ec-8461-ead391f8cf7c None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:24.258025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bcbf0-b102-42ec-8461-ead391f8cf7c None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:24.295557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde797a-7e4b-404c-9d61-c87cd48081a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:24.296419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde797a-7e4b-404c-9d61-c87cd48081a9 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:24.296684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde797a-7e4b-404c-9d61-c87cd48081a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:24.297018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde797a-7e4b-404c-9d61-c87cd48081a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:24.307179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde797a-7e4b-404c-9d61-c87cd48081a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:24.308659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde797a-7e4b-404c-9d61-c87cd48081a9 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:24.323828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-cdde797a-7e4b-404c-9d61-c87cd48081a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 22 19:43:24.325322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 614/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:24.332310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27866-5073-4ba7-87e8-d9845b5cb478 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:24.458530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27866-5073-4ba7-87e8-d9845b5cb478 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:24.498987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c438f5-ddbd-442d-86ae-5defa2decf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:24.499911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c438f5-ddbd-442d-86ae-5defa2decf20 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:24.500262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c438f5-ddbd-442d-86ae-5defa2decf20 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:24.500704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c438f5-ddbd-442d-86ae-5defa2decf20 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:24.501791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c438f5-ddbd-442d-86ae-5defa2decf20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:24.502710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c438f5-ddbd-442d-86ae-5defa2decf20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:24.504308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c438f5-ddbd-442d-86ae-5defa2decf20 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:24.523389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 613/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Mar 22 19:43:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:24.529429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde797a-7e4b-404c-9d61-c87cd48081a9 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:24.643700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde797a-7e4b-404c-9d61-c87cd48081a9 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:24.679722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdba057-a8f8-4803-80b4-7331b9b50f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:24.680516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdba057-a8f8-4803-80b4-7331b9b50f65 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:24.680800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdba057-a8f8-4803-80b4-7331b9b50f65 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:24.681071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdba057-a8f8-4803-80b4-7331b9b50f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:24.692240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdba057-a8f8-4803-80b4-7331b9b50f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:24.693709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdba057-a8f8-4803-80b4-7331b9b50f65 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:24.710524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-bbdba057-a8f8-4803-80b4-7331b9b50f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:24.711907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 615/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:24.717500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c438f5-ddbd-442d-86ae-5defa2decf20 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:24.819423 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c438f5-ddbd-442d-86ae-5defa2decf20 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:24.855801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146004d-017a-4268-94cb-41852e315236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:24.856452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146004d-017a-4268-94cb-41852e315236 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:24.856732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146004d-017a-4268-94cb-41852e315236 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:24.857003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146004d-017a-4268-94cb-41852e315236 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:24.857745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146004d-017a-4268-94cb-41852e315236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:24.858104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146004d-017a-4268-94cb-41852e315236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:24.859569 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146004d-017a-4268-94cb-41852e315236 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:24.872003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 614/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:24.877986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdba057-a8f8-4803-80b4-7331b9b50f65 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:24.983849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdba057-a8f8-4803-80b4-7331b9b50f65 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:25.017710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec448-4e8e-4e4e-a4bd-49403468aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:25.018632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec448-4e8e-4e4e-a4bd-49403468aa64 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:25.018910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec448-4e8e-4e4e-a4bd-49403468aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:25.019181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ec448-4e8e-4e4e-a4bd-49403468aa64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:25.026363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ec448-4e8e-4e4e-a4bd-49403468aa64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:25.027830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ec448-4e8e-4e4e-a4bd-49403468aa64 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:25.041750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-d77ec448-4e8e-4e4e-a4bd-49403468aa64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:43:25.043149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 616/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:25.049729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146004d-017a-4268-94cb-41852e315236 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:25.158455 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146004d-017a-4268-94cb-41852e315236 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:25.194631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01ec96-4c41-405d-9686-522e5ed6cd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:25.195300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01ec96-4c41-405d-9686-522e5ed6cd63 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:25.195580 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01ec96-4c41-405d-9686-522e5ed6cd63 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:25.195845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01ec96-4c41-405d-9686-522e5ed6cd63 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:25.196652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01ec96-4c41-405d-9686-522e5ed6cd63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:25.196993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01ec96-4c41-405d-9686-522e5ed6cd63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:25.198628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01ec96-4c41-405d-9686-522e5ed6cd63 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:25.212471 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 615/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:25.218794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec448-4e8e-4e4e-a4bd-49403468aa64 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:25.331101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ec448-4e8e-4e4e-a4bd-49403468aa64 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:25.373101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3025155-2fe1-486d-a5cc-ab426b60dac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:25.374112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3025155-2fe1-486d-a5cc-ab426b60dac0 None admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:25.374393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3025155-2fe1-486d-a5cc-ab426b60dac0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:25.374663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3025155-2fe1-486d-a5cc-ab426b60dac0 None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/eed3ec40f28c4bc990d8f56466889aff/roles/5a4466ef1a5f41b795e229b997885f2e` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:25.396614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3025155-2fe1-486d-a5cc-ab426b60dac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=eed3ec40f28c4bc990d8f56466889aff, role_id=5a4466ef1a5f41b795e229b997885f2e)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:25.400826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3025155-2fe1-486d-a5cc-ab426b60dac0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:25.414024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 617/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:43:25 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/eed3ec40f28c4bc990d8f56466889aff/roles/5a4466ef1a5f41b795e229b997885f2e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:43:28.019930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c161ad-0efc-4033-8216-8d5c603fc808 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:28.020484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c161ad-0efc-4033-8216-8d5c603fc808 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:28.020484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c161ad-0efc-4033-8216-8d5c603fc808 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:28.025716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 616/1233] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:28.028442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6769ce-42a9-4259-ab8a-607352646f79 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:28.028934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6769ce-42a9-4259-ab8a-607352646f79 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:28.029071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6769ce-42a9-4259-ab8a-607352646f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:28.047510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-ce6769ce-42a9-4259-ab8a-607352646f79 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:28.048903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ce6769ce-42a9-4259-ab8a-607352646f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:28.123833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 618/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:28.150852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c161ad-0efc-4033-8216-8d5c603fc808 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:28.264181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c161ad-0efc-4033-8216-8d5c603fc808 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:28.300838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96012a-ba2b-473c-b0ff-47837ed16e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:28.301773 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96012a-ba2b-473c-b0ff-47837ed16e08 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:28.302136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96012a-ba2b-473c-b0ff-47837ed16e08 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:28.302479 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96012a-ba2b-473c-b0ff-47837ed16e08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:28.314855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96012a-ba2b-473c-b0ff-47837ed16e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:43:28.322665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-6c96012a-ba2b-473c-b0ff-47837ed16e08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 22 19:43:28.324260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 617/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Mar 22 19:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:28.331622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6769ce-42a9-4259-ab8a-607352646f79 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:28.451734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6769ce-42a9-4259-ab8a-607352646f79 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:28.493254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485555d9-247d-4160-9591-e502f43e07ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:28.493986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485555d9-247d-4160-9591-e502f43e07ef None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:28.494266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485555d9-247d-4160-9591-e502f43e07ef None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:28.494531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485555d9-247d-4160-9591-e502f43e07ef None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:28.495304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485555d9-247d-4160-9591-e502f43e07ef None admin] RBAC: Adding query filter params (name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:28.495605 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485555d9-247d-4160-9591-e502f43e07ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:28.497004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485555d9-247d-4160-9591-e502f43e07ef None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:28.506299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 619/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Mar 22 19:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:28.513657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96012a-ba2b-473c-b0ff-47837ed16e08 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:28.629391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96012a-ba2b-473c-b0ff-47837ed16e08 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:28.667198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48f61b-fd1f-4aaf-99bb-d080ab1b073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:28.668062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48f61b-fd1f-4aaf-99bb-d080ab1b073a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:28.668437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48f61b-fd1f-4aaf-99bb-d080ab1b073a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:28.668640 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48f61b-fd1f-4aaf-99bb-d080ab1b073a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:28.682193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48f61b-fd1f-4aaf-99bb-d080ab1b073a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:28.683665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48f61b-fd1f-4aaf-99bb-d080ab1b073a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:28.701673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-cd48f61b-fd1f-4aaf-99bb-d080ab1b073a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:28.703224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 618/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:28.709440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485555d9-247d-4160-9591-e502f43e07ef None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:28.834517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485555d9-247d-4160-9591-e502f43e07ef None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:28.875427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48566e-1870-4e79-b744-08ce3f769083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:28.876317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48566e-1870-4e79-b744-08ce3f769083 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:28.876718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48566e-1870-4e79-b744-08ce3f769083 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:28.877123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48566e-1870-4e79-b744-08ce3f769083 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:28.877996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48566e-1870-4e79-b744-08ce3f769083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:28.878380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48566e-1870-4e79-b744-08ce3f769083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:28.880177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48566e-1870-4e79-b744-08ce3f769083 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:28.893375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 620/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:28.899321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48f61b-fd1f-4aaf-99bb-d080ab1b073a None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:29.024303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48f61b-fd1f-4aaf-99bb-d080ab1b073a None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:29.068916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c01b6d-140f-4bf2-ab26-e29a8d394a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:29.069803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c01b6d-140f-4bf2-ab26-e29a8d394a3f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:29.070113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c01b6d-140f-4bf2-ab26-e29a8d394a3f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:29.070389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c01b6d-140f-4bf2-ab26-e29a8d394a3f None admin] PATH_INFO: `/v3/users/placement` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:29.078667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c01b6d-140f-4bf2-ab26-e29a8d394a3f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:29.080279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c01b6d-140f-4bf2-ab26-e29a8d394a3f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:29.105116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-79c01b6d-140f-4bf2-ab26-e29a8d394a3f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 22 19:43:29.107380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 619/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:29.115940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48566e-1870-4e79-b744-08ce3f769083 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:29.235669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48566e-1870-4e79-b744-08ce3f769083 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:29.274179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102d7ab-0d38-4889-9875-60e9568b6da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:29.274918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102d7ab-0d38-4889-9875-60e9568b6da4 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:29.275277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102d7ab-0d38-4889-9875-60e9568b6da4 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:29.275560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102d7ab-0d38-4889-9875-60e9568b6da4 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:29.276669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102d7ab-0d38-4889-9875-60e9568b6da4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:29.277009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102d7ab-0d38-4889-9875-60e9568b6da4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:29.278658 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102d7ab-0d38-4889-9875-60e9568b6da4 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:29.298768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 621/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Mar 22 19:43:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:29.305654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c01b6d-140f-4bf2-ab26-e29a8d394a3f None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:29.448796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c01b6d-140f-4bf2-ab26-e29a8d394a3f None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:29.489806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc64da9-0584-43d3-a137-5d3102d3535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:29.490919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc64da9-0584-43d3-a137-5d3102d3535a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:29.491441 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc64da9-0584-43d3-a137-5d3102d3535a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:29.491838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc64da9-0584-43d3-a137-5d3102d3535a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:29.588874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc64da9-0584-43d3-a137-5d3102d3535a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:29.591258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc64da9-0584-43d3-a137-5d3102d3535a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:29.722530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 620/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:43:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:43:29.728555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102d7ab-0d38-4889-9875-60e9568b6da4 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:29.836953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102d7ab-0d38-4889-9875-60e9568b6da4 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:29.871594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232e87e-27ba-4b18-b58f-21780c9e4b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:29.872307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e87e-27ba-4b18-b58f-21780c9e4b03 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:29.872594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e87e-27ba-4b18-b58f-21780c9e4b03 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:29.872965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232e87e-27ba-4b18-b58f-21780c9e4b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:29.883785 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232e87e-27ba-4b18-b58f-21780c9e4b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:29.885245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232e87e-27ba-4b18-b58f-21780c9e4b03 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:29.905432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a232e87e-27ba-4b18-b58f-21780c9e4b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:29.907227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 622/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:29.913072 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc64da9-0584-43d3-a137-5d3102d3535a None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:30.024974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc64da9-0584-43d3-a137-5d3102d3535a None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:30.064695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b73033-0366-461a-bae8-d46b1bbd89e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:30.065389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b73033-0366-461a-bae8-d46b1bbd89e0 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:30.065667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b73033-0366-461a-bae8-d46b1bbd89e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:30.065977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b73033-0366-461a-bae8-d46b1bbd89e0 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:30.066696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b73033-0366-461a-bae8-d46b1bbd89e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:30.066998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b73033-0366-461a-bae8-d46b1bbd89e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:30.068399 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b73033-0366-461a-bae8-d46b1bbd89e0 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:30.081304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 621/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:30.088146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232e87e-27ba-4b18-b58f-21780c9e4b03 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:30.198983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232e87e-27ba-4b18-b58f-21780c9e4b03 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:30.243296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b453ef-e0ae-4275-aadf-241567a4e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:30.244124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b453ef-e0ae-4275-aadf-241567a4e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:30.244398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b453ef-e0ae-4275-aadf-241567a4e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:30.244672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b453ef-e0ae-4275-aadf-241567a4e4b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:30.253040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b453ef-e0ae-4275-aadf-241567a4e4b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:30.254634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b453ef-e0ae-4275-aadf-241567a4e4b7 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:30.270134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-01b453ef-e0ae-4275-aadf-241567a4e4b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:43:30.271521 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 623/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:30.277713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b73033-0366-461a-bae8-d46b1bbd89e0 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:30.395838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b73033-0366-461a-bae8-d46b1bbd89e0 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:30.432804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01304794-8783-4dd9-8ede-cbe57fa0d7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:30.433481 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304794-8783-4dd9-8ede-cbe57fa0d7bd None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:30.433763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304794-8783-4dd9-8ede-cbe57fa0d7bd None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:30.434069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304794-8783-4dd9-8ede-cbe57fa0d7bd None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:30.434880 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01304794-8783-4dd9-8ede-cbe57fa0d7bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:30.435199 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01304794-8783-4dd9-8ede-cbe57fa0d7bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:30.436711 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01304794-8783-4dd9-8ede-cbe57fa0d7bd None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:30.451253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 622/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:30.458962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b453ef-e0ae-4275-aadf-241567a4e4b7 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:30.566035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b453ef-e0ae-4275-aadf-241567a4e4b7 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:30.604463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ac265-e023-4d2d-a95c-f708543a4a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:30.605162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ac265-e023-4d2d-a95c-f708543a4a6e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:30.605437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ac265-e023-4d2d-a95c-f708543a4a6e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:30.605702 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ac265-e023-4d2d-a95c-f708543a4a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:30.606571 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ac265-e023-4d2d-a95c-f708543a4a6e None admin] RBAC: Adding query filter params (role.id=5a4466ef1a5f41b795e229b997885f2e, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=eed3ec40f28c4bc990d8f56466889aff) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:30.606879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ac265-e023-4d2d-a95c-f708543a4a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:30.608306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ac265-e023-4d2d-a95c-f708543a4a6e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:30.616599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 624/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:43:30 2022] GET /identity/v3/role_assignments?user.id=eed3ec40f28c4bc990d8f56466889aff&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=5a4466ef1a5f41b795e229b997885f2e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:33.243046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893b810-ce7f-42a4-9c39-7a12589d25f2 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:33.243677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893b810-ce7f-42a4-9c39-7a12589d25f2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:33.243677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893b810-ce7f-42a4-9c39-7a12589d25f2 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:33.245734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 623/1247] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:33.252332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019014e5-2cd9-4cb5-80ec-4f5da4b45e59 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:33.253044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019014e5-2cd9-4cb5-80ec-4f5da4b45e59 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:33.253044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019014e5-2cd9-4cb5-80ec-4f5da4b45e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:33.270940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-019014e5-2cd9-4cb5-80ec-4f5da4b45e59 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:33.272075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-019014e5-2cd9-4cb5-80ec-4f5da4b45e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:33.346497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 625/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:33.379012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893b810-ce7f-42a4-9c39-7a12589d25f2 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:33.500941 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893b810-ce7f-42a4-9c39-7a12589d25f2 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:33.538970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b201dae-c4a2-4d23-adb4-a29709301f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:33.539770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b201dae-c4a2-4d23-adb4-a29709301f6a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:33.540047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b201dae-c4a2-4d23-adb4-a29709301f6a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:33.540316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b201dae-c4a2-4d23-adb4-a29709301f6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:33.553006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b201dae-c4a2-4d23-adb4-a29709301f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:43:33.561581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-7b201dae-c4a2-4d23-adb4-a29709301f6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:43:33.563229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 624/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:43:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:33.569951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019014e5-2cd9-4cb5-80ec-4f5da4b45e59 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:33.681130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019014e5-2cd9-4cb5-80ec-4f5da4b45e59 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:33.726580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9f9d4-8574-45ca-b4e0-265f6de8d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:33.727682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9f9d4-8574-45ca-b4e0-265f6de8d450 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:33.728181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9f9d4-8574-45ca-b4e0-265f6de8d450 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:33.728663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9f9d4-8574-45ca-b4e0-265f6de8d450 None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:33.729988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9f9d4-8574-45ca-b4e0-265f6de8d450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:33.730514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9f9d4-8574-45ca-b4e0-265f6de8d450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:33.732975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9f9d4-8574-45ca-b4e0-265f6de8d450 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:33.746047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 626/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:43:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:33.753405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b201dae-c4a2-4d23-adb4-a29709301f6a None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:33.867003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b201dae-c4a2-4d23-adb4-a29709301f6a None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:33.902239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99679b6a-c64c-4bd7-b0e6-b1e48e80fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:33.903170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99679b6a-c64c-4bd7-b0e6-b1e48e80fb1a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:33.903480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99679b6a-c64c-4bd7-b0e6-b1e48e80fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:33.903755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99679b6a-c64c-4bd7-b0e6-b1e48e80fb1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:33.917434 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99679b6a-c64c-4bd7-b0e6-b1e48e80fb1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:33.918953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99679b6a-c64c-4bd7-b0e6-b1e48e80fb1a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:33.937219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-99679b6a-c64c-4bd7-b0e6-b1e48e80fb1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:33.938485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 625/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:33.945088 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9f9d4-8574-45ca-b4e0-265f6de8d450 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:34.056756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9f9d4-8574-45ca-b4e0-265f6de8d450 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:34.093031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe25c8-36eb-44a2-95f9-ef09aea609cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:34.093696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe25c8-36eb-44a2-95f9-ef09aea609cc None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:34.094008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe25c8-36eb-44a2-95f9-ef09aea609cc None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:34.094286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe25c8-36eb-44a2-95f9-ef09aea609cc None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:34.095010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe25c8-36eb-44a2-95f9-ef09aea609cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:34.095311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe25c8-36eb-44a2-95f9-ef09aea609cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:34.097052 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe25c8-36eb-44a2-95f9-ef09aea609cc None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:34.109697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 627/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:34.115758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99679b6a-c64c-4bd7-b0e6-b1e48e80fb1a None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:34.226499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99679b6a-c64c-4bd7-b0e6-b1e48e80fb1a None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:34.263273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0df3b3-29b1-4419-b6a5-9fb9996d6cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:34.264089 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0df3b3-29b1-4419-b6a5-9fb9996d6cba None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:34.264363 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0df3b3-29b1-4419-b6a5-9fb9996d6cba None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:34.264639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0df3b3-29b1-4419-b6a5-9fb9996d6cba None admin] PATH_INFO: `/v3/users/placement` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:34.273921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0df3b3-29b1-4419-b6a5-9fb9996d6cba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:34.275423 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0df3b3-29b1-4419-b6a5-9fb9996d6cba None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:34.290555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-be0df3b3-29b1-4419-b6a5-9fb9996d6cba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 22 19:43:34.292022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 626/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:34.297954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe25c8-36eb-44a2-95f9-ef09aea609cc None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:34.419519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe25c8-36eb-44a2-95f9-ef09aea609cc None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:34.457424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b5e4c-1077-41d6-894f-2a532ae94e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:34.458327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b5e4c-1077-41d6-894f-2a532ae94e3d None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:34.458642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b5e4c-1077-41d6-894f-2a532ae94e3d None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:34.458926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b5e4c-1077-41d6-894f-2a532ae94e3d None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:34.459783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b5e4c-1077-41d6-894f-2a532ae94e3d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:34.460100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b5e4c-1077-41d6-894f-2a532ae94e3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:34.461590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b5e4c-1077-41d6-894f-2a532ae94e3d None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:34.483688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 628/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Mar 22 19:43:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:34.490195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0df3b3-29b1-4419-b6a5-9fb9996d6cba None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:34.601654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0df3b3-29b1-4419-b6a5-9fb9996d6cba None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:34.636743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d0d76-0b85-46f9-820d-3ffdc1fe7435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:34.637388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d0d76-0b85-46f9-820d-3ffdc1fe7435 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:34.637657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d0d76-0b85-46f9-820d-3ffdc1fe7435 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:34.637929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d0d76-0b85-46f9-820d-3ffdc1fe7435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:34.710390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d0d76-0b85-46f9-820d-3ffdc1fe7435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:34.711913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d0d76-0b85-46f9-820d-3ffdc1fe7435 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:34.815410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 627/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:43:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:43:34.821302 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b5e4c-1077-41d6-894f-2a532ae94e3d None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:34.927601 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b5e4c-1077-41d6-894f-2a532ae94e3d None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:34.963141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87d26-41c6-4a83-8d93-18b5cff06a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:34.963932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87d26-41c6-4a83-8d93-18b5cff06a33 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:34.964213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87d26-41c6-4a83-8d93-18b5cff06a33 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:34.964501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be87d26-41c6-4a83-8d93-18b5cff06a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:34.975839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be87d26-41c6-4a83-8d93-18b5cff06a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:34.977484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be87d26-41c6-4a83-8d93-18b5cff06a33 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:34.994684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-4be87d26-41c6-4a83-8d93-18b5cff06a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:34.995941 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 629/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:35.002360 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d0d76-0b85-46f9-820d-3ffdc1fe7435 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:35.112459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d0d76-0b85-46f9-820d-3ffdc1fe7435 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:35.147290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25384-5698-4189-9fb6-b1d42f2a8653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:35.147951 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25384-5698-4189-9fb6-b1d42f2a8653 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:35.148234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25384-5698-4189-9fb6-b1d42f2a8653 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:35.148508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25384-5698-4189-9fb6-b1d42f2a8653 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:35.149258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25384-5698-4189-9fb6-b1d42f2a8653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:35.149568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25384-5698-4189-9fb6-b1d42f2a8653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:35.151016 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25384-5698-4189-9fb6-b1d42f2a8653 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:35.163211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 628/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:35.169384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87d26-41c6-4a83-8d93-18b5cff06a33 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:35.275963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be87d26-41c6-4a83-8d93-18b5cff06a33 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:35.316532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65befd-cec9-458e-8f1f-609da50a7999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:35.317341 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65befd-cec9-458e-8f1f-609da50a7999 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:35.317617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65befd-cec9-458e-8f1f-609da50a7999 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:35.317856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65befd-cec9-458e-8f1f-609da50a7999 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:35.324894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65befd-cec9-458e-8f1f-609da50a7999 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:35.326428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65befd-cec9-458e-8f1f-609da50a7999 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:35.341281 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-7c65befd-cec9-458e-8f1f-609da50a7999 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:43:35.342804 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 630/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 22 19:43:35.350752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25384-5698-4189-9fb6-b1d42f2a8653 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:35.476999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25384-5698-4189-9fb6-b1d42f2a8653 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:35.512243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90678-b469-4d89-9aa3-94f1794b3e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:35.512895 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90678-b469-4d89-9aa3-94f1794b3e83 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:35.513176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90678-b469-4d89-9aa3-94f1794b3e83 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:35.513451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90678-b469-4d89-9aa3-94f1794b3e83 None admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:35.514286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90678-b469-4d89-9aa3-94f1794b3e83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:35.514601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90678-b469-4d89-9aa3-94f1794b3e83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:35.516060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90678-b469-4d89-9aa3-94f1794b3e83 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:35.528767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 629/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:35.536098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65befd-cec9-458e-8f1f-609da50a7999 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:35.643272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65befd-cec9-458e-8f1f-609da50a7999 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:35.677534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0066e85-f1b1-441a-a8d8-8863768d89e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:35.678235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0066e85-f1b1-441a-a8d8-8863768d89e3 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:35.678509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0066e85-f1b1-441a-a8d8-8863768d89e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:35.678792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0066e85-f1b1-441a-a8d8-8863768d89e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:35.679681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0066e85-f1b1-441a-a8d8-8863768d89e3 None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=eed3ec40f28c4bc990d8f56466889aff) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:35.679985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0066e85-f1b1-441a-a8d8-8863768d89e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:35.681466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0066e85-f1b1-441a-a8d8-8863768d89e3 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:35.687438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 631/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:43:35 2022] GET /identity/v3/role_assignments?user.id=eed3ec40f28c4bc990d8f56466889aff&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:38.255545 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd756b05-e338-46dd-8af7-2d4d81595506 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:38.256090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd756b05-e338-46dd-8af7-2d4d81595506 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:38.256090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd756b05-e338-46dd-8af7-2d4d81595506 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:38.257825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 630/1261] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:38.263649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24753f0-ace6-4dc7-b3dd-ab9bcc960a21 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:38.264136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24753f0-ace6-4dc7-b3dd-ab9bcc960a21 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:38.264136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24753f0-ace6-4dc7-b3dd-ab9bcc960a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:38.284911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a24753f0-ace6-4dc7-b3dd-ab9bcc960a21 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:38.286158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a24753f0-ace6-4dc7-b3dd-ab9bcc960a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:38.359091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 632/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:38.397769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd756b05-e338-46dd-8af7-2d4d81595506 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:38.512532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd756b05-e338-46dd-8af7-2d4d81595506 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:38.550251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0817aa-baa9-48df-94b1-e973893df4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:38.551065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0817aa-baa9-48df-94b1-e973893df4a7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:38.551341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0817aa-baa9-48df-94b1-e973893df4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:38.551609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0817aa-baa9-48df-94b1-e973893df4a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:38.563770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0817aa-baa9-48df-94b1-e973893df4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:43:38.571333 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-be0817aa-baa9-48df-94b1-e973893df4a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:43:38.572707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 631/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:38.579890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24753f0-ace6-4dc7-b3dd-ab9bcc960a21 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:38.681712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24753f0-ace6-4dc7-b3dd-ab9bcc960a21 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:38.724049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ca11-ba18-4fbe-84d6-50945197cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:38.724806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ca11-ba18-4fbe-84d6-50945197cc3e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:38.725086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ca11-ba18-4fbe-84d6-50945197cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:38.725376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ca11-ba18-4fbe-84d6-50945197cc3e None admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:38.726174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7ca11-ba18-4fbe-84d6-50945197cc3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:38.726495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7ca11-ba18-4fbe-84d6-50945197cc3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:38.727970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7ca11-ba18-4fbe-84d6-50945197cc3e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:38.738561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 633/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:38.744542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0817aa-baa9-48df-94b1-e973893df4a7 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:38.861664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0817aa-baa9-48df-94b1-e973893df4a7 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:38.897876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0da6c-e5a9-43da-8924-9a275232d98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:38.898738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0da6c-e5a9-43da-8924-9a275232d98e None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:38.899019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0da6c-e5a9-43da-8924-9a275232d98e None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:38.899294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0da6c-e5a9-43da-8924-9a275232d98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:38.910638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0da6c-e5a9-43da-8924-9a275232d98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:38.912143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0da6c-e5a9-43da-8924-9a275232d98e None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:38.929387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-3ba0da6c-e5a9-43da-8924-9a275232d98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:38.930622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 632/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:38.936673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ca11-ba18-4fbe-84d6-50945197cc3e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:39.045690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ca11-ba18-4fbe-84d6-50945197cc3e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:39.080852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ce7b-c69a-44ef-8437-0db9ee7e3663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:39.081510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ce7b-c69a-44ef-8437-0db9ee7e3663 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:39.081785 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ce7b-c69a-44ef-8437-0db9ee7e3663 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:39.082087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ce7b-c69a-44ef-8437-0db9ee7e3663 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:39.082805 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ce7b-c69a-44ef-8437-0db9ee7e3663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:39.083100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ce7b-c69a-44ef-8437-0db9ee7e3663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:39.084534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ce7b-c69a-44ef-8437-0db9ee7e3663 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:39.097508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 634/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:39.103348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0da6c-e5a9-43da-8924-9a275232d98e None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:39.207071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0da6c-e5a9-43da-8924-9a275232d98e None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:39.243018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d3cba-5a88-49e6-a5f8-59934f82e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:39.243816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d3cba-5a88-49e6-a5f8-59934f82e829 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:39.244090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d3cba-5a88-49e6-a5f8-59934f82e829 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:39.244357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d3cba-5a88-49e6-a5f8-59934f82e829 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:39.252821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d3cba-5a88-49e6-a5f8-59934f82e829 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:39.254293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d3cba-5a88-49e6-a5f8-59934f82e829 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:39.268654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-0c3d3cba-5a88-49e6-a5f8-59934f82e829 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 22 19:43:39.269868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 633/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:39.275835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ce7b-c69a-44ef-8437-0db9ee7e3663 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:39.418719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ce7b-c69a-44ef-8437-0db9ee7e3663 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:39.455288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01160-24e6-418a-9e31-5dc6a9f42119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:39.455951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01160-24e6-418a-9e31-5dc6a9f42119 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:39.456228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01160-24e6-418a-9e31-5dc6a9f42119 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:39.456503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa01160-24e6-418a-9e31-5dc6a9f42119 None admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:39.457418 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa01160-24e6-418a-9e31-5dc6a9f42119 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:39.457743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa01160-24e6-418a-9e31-5dc6a9f42119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:39.459277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa01160-24e6-418a-9e31-5dc6a9f42119 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:39.479997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 635/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Mar 22 19:43:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:39.486044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d3cba-5a88-49e6-a5f8-59934f82e829 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:39.606883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d3cba-5a88-49e6-a5f8-59934f82e829 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:39.642497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea5588-033c-4d7e-9885-af5db9068f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:39.643387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea5588-033c-4d7e-9885-af5db9068f32 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:39.643838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea5588-033c-4d7e-9885-af5db9068f32 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:39.644141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea5588-033c-4d7e-9885-af5db9068f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:39.656150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea5588-033c-4d7e-9885-af5db9068f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:39.657753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea5588-033c-4d7e-9885-af5db9068f32 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:39.675883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-54ea5588-033c-4d7e-9885-af5db9068f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:39.677057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 634/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:39.683210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01160-24e6-418a-9e31-5dc6a9f42119 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:39.794700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa01160-24e6-418a-9e31-5dc6a9f42119 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:39.838700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be39d5f-27aa-4b3a-8721-d60258389d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:39.839991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be39d5f-27aa-4b3a-8721-d60258389d18 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:39.840190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be39d5f-27aa-4b3a-8721-d60258389d18 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:39.840555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be39d5f-27aa-4b3a-8721-d60258389d18 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:39.841471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be39d5f-27aa-4b3a-8721-d60258389d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:39.841867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be39d5f-27aa-4b3a-8721-d60258389d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:39.843438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be39d5f-27aa-4b3a-8721-d60258389d18 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:39.856034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 636/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:39.863414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea5588-033c-4d7e-9885-af5db9068f32 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:39.966404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea5588-033c-4d7e-9885-af5db9068f32 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:40.004273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d277a-4ab6-4140-be95-5ad410430b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:40.005106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d277a-4ab6-4140-be95-5ad410430b92 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:40.005384 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d277a-4ab6-4140-be95-5ad410430b92 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:40.005657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d277a-4ab6-4140-be95-5ad410430b92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:40.013505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d277a-4ab6-4140-be95-5ad410430b92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:40.015091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d277a-4ab6-4140-be95-5ad410430b92 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:40.029890 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-5c3d277a-4ab6-4140-be95-5ad410430b92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:43:40.031157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 635/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:40.037762 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be39d5f-27aa-4b3a-8721-d60258389d18 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:40.146315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be39d5f-27aa-4b3a-8721-d60258389d18 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:40.181227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07309491-4328-4d01-9277-1161b2abe845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:40.181913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07309491-4328-4d01-9277-1161b2abe845 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:40.182231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07309491-4328-4d01-9277-1161b2abe845 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:40.182508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07309491-4328-4d01-9277-1161b2abe845 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:40.183334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07309491-4328-4d01-9277-1161b2abe845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:40.183642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07309491-4328-4d01-9277-1161b2abe845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:40.185113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07309491-4328-4d01-9277-1161b2abe845 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:40.198313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 637/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:40.204774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d277a-4ab6-4140-be95-5ad410430b92 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:40.309214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d277a-4ab6-4140-be95-5ad410430b92 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:40.350301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58fd70-f45a-4eba-9bf8-9beb8de34c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:40.351498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58fd70-f45a-4eba-9bf8-9beb8de34c8b None admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:40.351763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58fd70-f45a-4eba-9bf8-9beb8de34c8b None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:40.351943 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58fd70-f45a-4eba-9bf8-9beb8de34c8b None admin] PATH_INFO: `/v3/projects/223e4823a4424338869a4b614a8dceb5/users/eed3ec40f28c4bc990d8f56466889aff/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:40.354337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58fd70-f45a-4eba-9bf8-9beb8de34c8b None admin] RBAC: Authorizing `identity:create_grant(project_id=223e4823a4424338869a4b614a8dceb5, user_id=eed3ec40f28c4bc990d8f56466889aff, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:40.355924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58fd70-f45a-4eba-9bf8-9beb8de34c8b None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:40.373742 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 636/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Mar 22 19:43:40 2022] PUT /identity/v3/projects/223e4823a4424338869a4b614a8dceb5/users/eed3ec40f28c4bc990d8f56466889aff/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:43:43.163889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329811a0-b040-4849-a2a0-c3d323fccc3d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:43.164461 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329811a0-b040-4849-a2a0-c3d323fccc3d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:43.164461 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329811a0-b040-4849-a2a0-c3d323fccc3d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:43.166754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 638/1274] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:43.173115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad6228-cb75-44d0-b841-c516459522db None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:43.173757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad6228-cb75-44d0-b841-c516459522db None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:43.173984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad6228-cb75-44d0-b841-c516459522db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:43.197481 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4aad6228-cb75-44d0-b841-c516459522db None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:43.199117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4aad6228-cb75-44d0-b841-c516459522db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:43.290728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 637/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:43.318833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329811a0-b040-4849-a2a0-c3d323fccc3d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:43.451987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329811a0-b040-4849-a2a0-c3d323fccc3d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:43.496591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09612d36-27f2-4f9d-b312-34fa94fe6813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:43.497517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09612d36-27f2-4f9d-b312-34fa94fe6813 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:43.497818 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09612d36-27f2-4f9d-b312-34fa94fe6813 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:43.498309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09612d36-27f2-4f9d-b312-34fa94fe6813 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:43.514412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09612d36-27f2-4f9d-b312-34fa94fe6813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 22 19:43:43.523202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-09612d36-27f2-4f9d-b312-34fa94fe6813 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 22 19:43:43.524617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 639/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Mar 22 19:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:43.533021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad6228-cb75-44d0-b841-c516459522db None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:43.648228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad6228-cb75-44d0-b841-c516459522db None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:43.686335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdc93e-aaf4-479a-8ce8-fa7946d6c360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:43.687129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdc93e-aaf4-479a-8ce8-fa7946d6c360 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:43.687495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdc93e-aaf4-479a-8ce8-fa7946d6c360 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:43.687826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdc93e-aaf4-479a-8ce8-fa7946d6c360 None admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:43.688666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdc93e-aaf4-479a-8ce8-fa7946d6c360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:43.689428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdc93e-aaf4-479a-8ce8-fa7946d6c360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:43.690523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdc93e-aaf4-479a-8ce8-fa7946d6c360 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:43.700774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 638/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Mar 22 19:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:43.706936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09612d36-27f2-4f9d-b312-34fa94fe6813 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:43.832284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09612d36-27f2-4f9d-b312-34fa94fe6813 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:43.872867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa186b23-056a-4c53-a8a2-cc78e825e67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:43.873665 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa186b23-056a-4c53-a8a2-cc78e825e67e None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:43.873973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa186b23-056a-4c53-a8a2-cc78e825e67e None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:43.874246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa186b23-056a-4c53-a8a2-cc78e825e67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:43.885830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa186b23-056a-4c53-a8a2-cc78e825e67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:43.887355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa186b23-056a-4c53-a8a2-cc78e825e67e None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:43.905686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-aa186b23-056a-4c53-a8a2-cc78e825e67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:43.906959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 640/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:43.913190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdc93e-aaf4-479a-8ce8-fa7946d6c360 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:44.028430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdc93e-aaf4-479a-8ce8-fa7946d6c360 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:44.063629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14487d67-1f2c-43c6-aff2-21b9ebddc684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:44.064428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14487d67-1f2c-43c6-aff2-21b9ebddc684 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:44.064744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14487d67-1f2c-43c6-aff2-21b9ebddc684 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:44.065001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14487d67-1f2c-43c6-aff2-21b9ebddc684 None admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:44.065782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14487d67-1f2c-43c6-aff2-21b9ebddc684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:44.066142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14487d67-1f2c-43c6-aff2-21b9ebddc684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:44.067592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14487d67-1f2c-43c6-aff2-21b9ebddc684 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:44.081272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 639/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:44.088085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa186b23-056a-4c53-a8a2-cc78e825e67e None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:44.202227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa186b23-056a-4c53-a8a2-cc78e825e67e None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:44.244268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01705ab-9864-4f67-ac54-c7bfc0f9e3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:44.245148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01705ab-9864-4f67-ac54-c7bfc0f9e3f6 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:44.245533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01705ab-9864-4f67-ac54-c7bfc0f9e3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:44.245860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01705ab-9864-4f67-ac54-c7bfc0f9e3f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:44.255036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01705ab-9864-4f67-ac54-c7bfc0f9e3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:44.256645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01705ab-9864-4f67-ac54-c7bfc0f9e3f6 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:44.272795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-a01705ab-9864-4f67-ac54-c7bfc0f9e3f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 22 19:43:44.274170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 641/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:44.280974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14487d67-1f2c-43c6-aff2-21b9ebddc684 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:44.406773 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14487d67-1f2c-43c6-aff2-21b9ebddc684 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:44.442989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88439-2923-4e34-921e-655a88dd9033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:44.443694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88439-2923-4e34-921e-655a88dd9033 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:44.443979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88439-2923-4e34-921e-655a88dd9033 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:44.444242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88439-2923-4e34-921e-655a88dd9033 None admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:44.445079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88439-2923-4e34-921e-655a88dd9033 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:44.445392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88439-2923-4e34-921e-655a88dd9033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:44.446885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88439-2923-4e34-921e-655a88dd9033 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:44.465581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 640/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Mar 22 19:43:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:44.472636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01705ab-9864-4f67-ac54-c7bfc0f9e3f6 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:44.586102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01705ab-9864-4f67-ac54-c7bfc0f9e3f6 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:44.625561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7830a85-4f42-4779-9a50-6f580fffe55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:44.626361 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7830a85-4f42-4779-9a50-6f580fffe55b None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:44.626880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7830a85-4f42-4779-9a50-6f580fffe55b None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:44.626880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7830a85-4f42-4779-9a50-6f580fffe55b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:44.719082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7830a85-4f42-4779-9a50-6f580fffe55b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:44.720646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7830a85-4f42-4779-9a50-6f580fffe55b None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:44.849499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 642/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Mar 22 19:43:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 22 19:43:44.855695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88439-2923-4e34-921e-655a88dd9033 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:44.977079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88439-2923-4e34-921e-655a88dd9033 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:45.020890 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabbdce-9d11-4a84-bfd6-5a4dc3ba2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:45.021913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabbdce-9d11-4a84-bfd6-5a4dc3ba2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:45.022237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabbdce-9d11-4a84-bfd6-5a4dc3ba2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:45.022606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabbdce-9d11-4a84-bfd6-5a4dc3ba2ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:45.035576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabbdce-9d11-4a84-bfd6-5a4dc3ba2ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:45.037329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabbdce-9d11-4a84-bfd6-5a4dc3ba2ca7 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:45.058248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-5aabbdce-9d11-4a84-bfd6-5a4dc3ba2ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 22 19:43:45.059839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 641/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:45.066856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7830a85-4f42-4779-9a50-6f580fffe55b None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:45.180656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7830a85-4f42-4779-9a50-6f580fffe55b None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:45.216814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866121cd-a9b6-433a-9f15-951575ac5ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:45.217498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866121cd-a9b6-433a-9f15-951575ac5ab5 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:45.217753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866121cd-a9b6-433a-9f15-951575ac5ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:45.218049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866121cd-a9b6-433a-9f15-951575ac5ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:45.218770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866121cd-a9b6-433a-9f15-951575ac5ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:45.219069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866121cd-a9b6-433a-9f15-951575ac5ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:45.220554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866121cd-a9b6-433a-9f15-951575ac5ab5 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:45.233255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 643/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Mar 22 19:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:43:45.239369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabbdce-9d11-4a84-bfd6-5a4dc3ba2ca7 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:45.362297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabbdce-9d11-4a84-bfd6-5a4dc3ba2ca7 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:45.420822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa459a-e919-46d1-9957-4da085a96da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:45.422046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa459a-e919-46d1-9957-4da085a96da4 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:45.422410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa459a-e919-46d1-9957-4da085a96da4 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:45.422977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa459a-e919-46d1-9957-4da085a96da4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:45.435235 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa459a-e919-46d1-9957-4da085a96da4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:45.437749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa459a-e919-46d1-9957-4da085a96da4 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:45.461190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING keystone.server.flask.application [None req-41aa459a-e919-46d1-9957-4da085a96da4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 22 19:43:45.463821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 642/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Mar 22 19:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:45.472389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866121cd-a9b6-433a-9f15-951575ac5ab5 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:45.597565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866121cd-a9b6-433a-9f15-951575ac5ab5 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:45.639102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86d149-4cf0-4082-bfd4-45e4e943ec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:45.639810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86d149-4cf0-4082-bfd4-45e4e943ec77 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:45.640102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86d149-4cf0-4082-bfd4-45e4e943ec77 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:45.640374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86d149-4cf0-4082-bfd4-45e4e943ec77 None admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:45.641242 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86d149-4cf0-4082-bfd4-45e4e943ec77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:45.641692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86d149-4cf0-4082-bfd4-45e4e943ec77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:45.643171 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86d149-4cf0-4082-bfd4-45e4e943ec77 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:45.658728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 644/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Mar 22 19:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:45.666158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa459a-e919-46d1-9957-4da085a96da4 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:45.784442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa459a-e919-46d1-9957-4da085a96da4 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:45.826083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78730eaf-a9f0-4610-b494-ea20dcc0508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:45.826830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730eaf-a9f0-4610-b494-ea20dcc0508f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:45.827109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730eaf-a9f0-4610-b494-ea20dcc0508f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:45.827403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78730eaf-a9f0-4610-b494-ea20dcc0508f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:45.828411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78730eaf-a9f0-4610-b494-ea20dcc0508f None admin] RBAC: Adding query filter params (role.id=e19a3260f1b64f78a8de1f8d6a6a8988, scope.project.id=223e4823a4424338869a4b614a8dceb5, user.id=eed3ec40f28c4bc990d8f56466889aff) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:45.828734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78730eaf-a9f0-4610-b494-ea20dcc0508f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:45.830382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78730eaf-a9f0-4610-b494-ea20dcc0508f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:45.838794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 643/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Mar 22 19:43:45 2022] GET /identity/v3/role_assignments?user.id=eed3ec40f28c4bc990d8f56466889aff&scope.project.id=223e4823a4424338869a4b614a8dceb5&role.id=e19a3260f1b64f78a8de1f8d6a6a8988 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:48.548614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c074be-9008-4bc0-9e31-190a23086bf2 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:48.549254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c074be-9008-4bc0-9e31-190a23086bf2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:48.549254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c074be-9008-4bc0-9e31-190a23086bf2 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:48.552078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 645/1288] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:48.557677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c7a53-b63e-4977-8b40-682f3626e89e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:48.558251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c7a53-b63e-4977-8b40-682f3626e89e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:48.558251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c7a53-b63e-4977-8b40-682f3626e89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:48.575390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8f4c7a53-b63e-4977-8b40-682f3626e89e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:48.576586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8f4c7a53-b63e-4977-8b40-682f3626e89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:48.655348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 644/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 22 19:43:48.678998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c074be-9008-4bc0-9e31-190a23086bf2 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:48.799411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c074be-9008-4bc0-9e31-190a23086bf2 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:48.835064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c456-6b27-4a0a-b520-63fb0e811441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:48.835876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c456-6b27-4a0a-b520-63fb0e811441 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:48.836153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c456-6b27-4a0a-b520-63fb0e811441 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:48.836427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c456-6b27-4a0a-b520-63fb0e811441 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:48.837089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1c456-6b27-4a0a-b520-63fb0e811441 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:48.838531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1c456-6b27-4a0a-b520-63fb0e811441 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:48.850959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-c9f1c456-6b27-4a0a-b520-63fb0e811441 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 22 19:43:48.852191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 646/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:43:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:48.859485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c7a53-b63e-4977-8b40-682f3626e89e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:48.984814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c7a53-b63e-4977-8b40-682f3626e89e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:49.020716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f34ed5-4fd2-424b-bf26-9b75ae4ab21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:49.021398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f34ed5-4fd2-424b-bf26-9b75ae4ab21a None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:49.021677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f34ed5-4fd2-424b-bf26-9b75ae4ab21a None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:49.021978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f34ed5-4fd2-424b-bf26-9b75ae4ab21a None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:49.022694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f34ed5-4fd2-424b-bf26-9b75ae4ab21a None admin] RBAC: Adding query filter params (name=placement) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:49.023017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f34ed5-4fd2-424b-bf26-9b75ae4ab21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:49.024391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f34ed5-4fd2-424b-bf26-9b75ae4ab21a None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:49.029669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 645/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Mar 22 19:43:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:49.036093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c456-6b27-4a0a-b520-63fb0e811441 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:49.160322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c456-6b27-4a0a-b520-63fb0e811441 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:49.201132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127290c6-2ff9-4a92-aa46-8e706efd59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:49.201876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127290c6-2ff9-4a92-aa46-8e706efd59c1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:49.202198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127290c6-2ff9-4a92-aa46-8e706efd59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:49.202469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127290c6-2ff9-4a92-aa46-8e706efd59c1 None admin] PATH_INFO: `/v3/services` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:49.203213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127290c6-2ff9-4a92-aa46-8e706efd59c1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:49.203513 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127290c6-2ff9-4a92-aa46-8e706efd59c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:49.205186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127290c6-2ff9-4a92-aa46-8e706efd59c1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:49.210769 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 647/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Mar 22 19:43:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:51.610625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbddea-c1d9-4590-92f9-d7121bee62ae None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:51.611225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbddea-c1d9-4590-92f9-d7121bee62ae None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:51.611225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbddea-c1d9-4590-92f9-d7121bee62ae None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:51.612941 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 646/1293] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:51.618456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb65eb-7bdf-4718-ab97-1e20257e7e07 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:51.618894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb65eb-7bdf-4718-ab97-1e20257e7e07 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:51.619012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb65eb-7bdf-4718-ab97-1e20257e7e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:51.636942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-bacb65eb-7bdf-4718-ab97-1e20257e7e07 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:51.638180 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-bacb65eb-7bdf-4718-ab97-1e20257e7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:51.707420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 648/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:51.731952 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbddea-c1d9-4590-92f9-d7121bee62ae None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:51.840436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbddea-c1d9-4590-92f9-d7121bee62ae None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:51.875646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaa270-d0c5-43da-b5c4-b3e5863372a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:51.876295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaa270-d0c5-43da-b5c4-b3e5863372a5 None admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:51.876566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaa270-d0c5-43da-b5c4-b3e5863372a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:51.876796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaa270-d0c5-43da-b5c4-b3e5863372a5 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:51.877554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaa270-d0c5-43da-b5c4-b3e5863372a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:51.878965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaa270-d0c5-43da-b5c4-b3e5863372a5 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:51.894111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 647/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Mar 22 19:43:51 2022] POST /identity/v3/services => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:43:54.265585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b78f-b574-4a7d-8b87-8b01fdbbcc04 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:54.266250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b78f-b574-4a7d-8b87-8b01fdbbcc04 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:54.266250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b78f-b574-4a7d-8b87-8b01fdbbcc04 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:54.268016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 649/1296] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:54.274265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd5cb0-a438-4152-8631-55c2f8801c18 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:54.274883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd5cb0-a438-4152-8631-55c2f8801c18 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:54.274883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd5cb0-a438-4152-8631-55c2f8801c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:54.294602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-95bd5cb0-a438-4152-8631-55c2f8801c18 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:54.295841 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-95bd5cb0-a438-4152-8631-55c2f8801c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:54.378781 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 648/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:54.402162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b78f-b574-4a7d-8b87-8b01fdbbcc04 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:54.517640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b78f-b574-4a7d-8b87-8b01fdbbcc04 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:54.555569 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb018a51-df00-4ce5-b0f8-166a31d12df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:54.556386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb018a51-df00-4ce5-b0f8-166a31d12df1 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:54.556735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb018a51-df00-4ce5-b0f8-166a31d12df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:54.557022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb018a51-df00-4ce5-b0f8-166a31d12df1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:54.557694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb018a51-df00-4ce5-b0f8-166a31d12df1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:54.559148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb018a51-df00-4ce5-b0f8-166a31d12df1 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:54.571409 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-cb018a51-df00-4ce5-b0f8-166a31d12df1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 22 19:43:54.572739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 650/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:43:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:54.579352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd5cb0-a438-4152-8631-55c2f8801c18 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:54.685232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd5cb0-a438-4152-8631-55c2f8801c18 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:54.722358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d4584-33dd-44e6-af73-7b828ae39051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:54.723049 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d4584-33dd-44e6-af73-7b828ae39051 None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:54.723328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d4584-33dd-44e6-af73-7b828ae39051 None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:54.723600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d4584-33dd-44e6-af73-7b828ae39051 None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:54.724329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d4584-33dd-44e6-af73-7b828ae39051 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:54.724635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d4584-33dd-44e6-af73-7b828ae39051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:54.726070 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d4584-33dd-44e6-af73-7b828ae39051 None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:54.732205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 649/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Mar 22 19:43:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:54.738949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb018a51-df00-4ce5-b0f8-166a31d12df1 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:54.855761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb018a51-df00-4ce5-b0f8-166a31d12df1 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:54.893012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a345c-34c3-47b1-bb1c-a20a46949225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:54.893697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a345c-34c3-47b1-bb1c-a20a46949225 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:54.893981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a345c-34c3-47b1-bb1c-a20a46949225 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:54.894280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a345c-34c3-47b1-bb1c-a20a46949225 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:54.895097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a345c-34c3-47b1-bb1c-a20a46949225 None admin] RBAC: Adding query filter params (interface=public, service_id=e72b12c4497440fa85667d74c811c244, region_id=RegionOne) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:54.895406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a345c-34c3-47b1-bb1c-a20a46949225 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:54.896797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a345c-34c3-47b1-bb1c-a20a46949225 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:54.903081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 651/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Mar 22 19:43:54 2022] GET /identity/v3/endpoints?service_id=e72b12c4497440fa85667d74c811c244&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:54.909247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d4584-33dd-44e6-af73-7b828ae39051 None admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:55.025530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d4584-33dd-44e6-af73-7b828ae39051 None admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:55.060719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aec795-4527-4fae-a7a7-2015487ecd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:55.061383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aec795-4527-4fae-a7a7-2015487ecd0f None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:55.061657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aec795-4527-4fae-a7a7-2015487ecd0f None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:55.061932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aec795-4527-4fae-a7a7-2015487ecd0f None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:55.062649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aec795-4527-4fae-a7a7-2015487ecd0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:55.064121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aec795-4527-4fae-a7a7-2015487ecd0f None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:55.070971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 650/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Mar 22 19:43:54 2022] GET /identity/v3/services => generated 2191 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:43:57.410872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda19f8-9679-4956-a7fd-da0750bbe66d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:57.411457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda19f8-9679-4956-a7fd-da0750bbe66d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:57.411457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda19f8-9679-4956-a7fd-da0750bbe66d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:57.413214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 652/1302] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:43:57.418652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3dd2-118c-4acc-87bf-9bdbb4e5c71f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:57.419105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3dd2-118c-4acc-87bf-9bdbb4e5c71f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:57.419195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3dd2-118c-4acc-87bf-9bdbb4e5c71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:57.436518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8c6b3dd2-118c-4acc-87bf-9bdbb4e5c71f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:43:57.437701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8c6b3dd2-118c-4acc-87bf-9bdbb4e5c71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:43:57.505557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 651/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:43:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 22 19:43:57.529254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda19f8-9679-4956-a7fd-da0750bbe66d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:57.636055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda19f8-9679-4956-a7fd-da0750bbe66d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:57.674807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93cc19-b01c-4fbe-abd3-ef28576db838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:57.675524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93cc19-b01c-4fbe-abd3-ef28576db838 None admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:57.675802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93cc19-b01c-4fbe-abd3-ef28576db838 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:57.676046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93cc19-b01c-4fbe-abd3-ef28576db838 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:57.676725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93cc19-b01c-4fbe-abd3-ef28576db838 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:57.678112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93cc19-b01c-4fbe-abd3-ef28576db838 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:57.689150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING keystone.server.flask.application [None req-af93cc19-b01c-4fbe-abd3-ef28576db838 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 22 19:43:57.690340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 653/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Mar 22 19:43:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 22 19:43:57.696714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b3dd2-118c-4acc-87bf-9bdbb4e5c71f None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:57.797741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b3dd2-118c-4acc-87bf-9bdbb4e5c71f None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:57.831957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0701d4e-ac7d-44fb-9479-dc334be3a51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:57.832635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0701d4e-ac7d-44fb-9479-dc334be3a51d None admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:57.835148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0701d4e-ac7d-44fb-9479-dc334be3a51d None admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:57.835148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0701d4e-ac7d-44fb-9479-dc334be3a51d None admin] PATH_INFO: `/v3/services` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:57.835148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0701d4e-ac7d-44fb-9479-dc334be3a51d None admin] RBAC: Adding query filter params (name=placement) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:43:57.835148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0701d4e-ac7d-44fb-9479-dc334be3a51d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:57.835634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0701d4e-ac7d-44fb-9479-dc334be3a51d None admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:57.841117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 652/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Mar 22 19:43:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:43:57.847611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93cc19-b01c-4fbe-abd3-ef28576db838 None admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:43:57.946081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93cc19-b01c-4fbe-abd3-ef28576db838 None admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:43:57.981422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ea4e8-05e0-4b32-8573-b4d4b00302f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:43:57.982129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ea4e8-05e0-4b32-8573-b4d4b00302f0 None admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:43:57.982410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ea4e8-05e0-4b32-8573-b4d4b00302f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:43:57.982682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ea4e8-05e0-4b32-8573-b4d4b00302f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:43:57.983424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ea4e8-05e0-4b32-8573-b4d4b00302f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:43:57.984843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ea4e8-05e0-4b32-8573-b4d4b00302f0 None admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:43:58.005679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 654/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Mar 22 19:43:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:45:05.811097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d074-9653-48e2-9c45-c28474d1e823 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:05.811982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d074-9653-48e2-9c45-c28474d1e823 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:05.811982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d074-9653-48e2-9c45-c28474d1e823 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:05.818275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 653/1307] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:05.820289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018f9a-8a96-4bd7-9394-349e0cfb2ddf None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:05.821412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018f9a-8a96-4bd7-9394-349e0cfb2ddf None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:05.821708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018f9a-8a96-4bd7-9394-349e0cfb2ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:05.917954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-75018f9a-8a96-4bd7-9394-349e0cfb2ddf None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:05.919627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-75018f9a-8a96-4bd7-9394-349e0cfb2ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:06.066537 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 655/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:06.089929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d074-9653-48e2-9c45-c28474d1e823 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:06.092010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-35d1d074-9653-48e2-9c45-c28474d1e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:06.280299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d074-9653-48e2-9c45-c28474d1e823 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:06.425411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c5139-5216-42d5-b933-c1ba9f8d29ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:06.428566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c5139-5216-42d5-b933-c1ba9f8d29ce admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:06.430655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c5139-5216-42d5-b933-c1ba9f8d29ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:06.431184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c5139-5216-42d5-b933-c1ba9f8d29ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:06.432117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c5139-5216-42d5-b933-c1ba9f8d29ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:06.434302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING py.warnings [None req-a31c5139-5216-42d5-b933-c1ba9f8d29ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:45:06.434302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: warnings.warn(msg) Mar 22 19:45:06.434302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: Mar 22 19:45:06.436145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c5139-5216-42d5-b933-c1ba9f8d29ce admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:06.472061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 654/1309] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:45:06 2022] GET /identity/v3/projects => generated 2553 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:45:08.914206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f1796-f101-45c7-bbe1-db3786802b91 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:08.914775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f1796-f101-45c7-bbe1-db3786802b91 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:08.914775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f1796-f101-45c7-bbe1-db3786802b91 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:08.916612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 656/1310] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:08.922967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8184e-1a17-493f-ac08-de2f113a22d4 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:08.923486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8184e-1a17-493f-ac08-de2f113a22d4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:08.923649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8184e-1a17-493f-ac08-de2f113a22d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:09.015879 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-29e8184e-1a17-493f-ac08-de2f113a22d4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:09.017109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-29e8184e-1a17-493f-ac08-de2f113a22d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:09.133245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 655/1311] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:09.188500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32430e64-afd0-41e2-8bda-cb5fbb136018 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:09.188787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32430e64-afd0-41e2-8bda-cb5fbb136018 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:09.189059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32430e64-afd0-41e2-8bda-cb5fbb136018 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:09.191325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 657/1312] 10.222.0.49 () {54 vars in 963 bytes} [Tue Mar 22 19:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:45:09.197681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcaeac-2693-4dd8-84bd-2016fde75c89 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:09.198068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcaeac-2693-4dd8-84bd-2016fde75c89 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:09.198439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcaeac-2693-4dd8-84bd-2016fde75c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:09.284610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-acdcaeac-2693-4dd8-84bd-2016fde75c89 None None] MFA Rules not processed for user `c2e837368cdc4df29d945a4c8e662a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:09.285792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-acdcaeac-2693-4dd8-84bd-2016fde75c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:09.383847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 656/1313] 10.222.0.49 () {58 vars in 1060 bytes} [Tue Mar 22 19:45:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:09.394115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32430e64-afd0-41e2-8bda-cb5fbb136018 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:09.395726 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-32430e64-afd0-41e2-8bda-cb5fbb136018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:09.518624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32430e64-afd0-41e2-8bda-cb5fbb136018 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:09.606811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b667d0-cf04-460b-a742-368666b5ea49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:09.607503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b667d0-cf04-460b-a742-368666b5ea49 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:09.607811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b667d0-cf04-460b-a742-368666b5ea49 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:09.608957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b667d0-cf04-460b-a742-368666b5ea49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:09.610985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-19b667d0-cf04-460b-a742-368666b5ea49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:09.741340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b667d0-cf04-460b-a742-368666b5ea49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:09.742856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b667d0-cf04-460b-a742-368666b5ea49 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:09.763620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 658/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:12.433557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c1097-7b1b-4239-a768-8dd094b34dd3 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:12.434155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c1097-7b1b-4239-a768-8dd094b34dd3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:12.434155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c1097-7b1b-4239-a768-8dd094b34dd3 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:12.436087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 657/1315] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:12.441900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7b65b-a839-4b0b-be8c-812c021ffd75 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:12.442474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7b65b-a839-4b0b-be8c-812c021ffd75 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:12.442474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7b65b-a839-4b0b-be8c-812c021ffd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:12.520869 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-90c7b65b-a839-4b0b-be8c-812c021ffd75 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:12.522145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-90c7b65b-a839-4b0b-be8c-812c021ffd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:12.638326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 659/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:12.695239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965424b8-db75-46f5-8ecc-94729f387b67 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:12.695486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965424b8-db75-46f5-8ecc-94729f387b67 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:12.695766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965424b8-db75-46f5-8ecc-94729f387b67 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:12.697820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 658/1317] 10.222.0.49 () {54 vars in 963 bytes} [Tue Mar 22 19:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:12.705804 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1f04e-d595-4ef0-bd1c-349c3a2ee3f2 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:12.706167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1f04e-d595-4ef0-bd1c-349c3a2ee3f2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:12.706460 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1f04e-d595-4ef0-bd1c-349c3a2ee3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:12.796677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d0d1f04e-d595-4ef0-bd1c-349c3a2ee3f2 None None] MFA Rules not processed for user `c2e837368cdc4df29d945a4c8e662a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:12.797914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d0d1f04e-d595-4ef0-bd1c-349c3a2ee3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:12.887411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 660/1318] 10.222.0.49 () {58 vars in 1060 bytes} [Tue Mar 22 19:45:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:12.897219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965424b8-db75-46f5-8ecc-94729f387b67 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:12.898825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-965424b8-db75-46f5-8ecc-94729f387b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:13.010673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965424b8-db75-46f5-8ecc-94729f387b67 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:13.088850 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2265b3f-5fc3-4df4-8915-d4028d4da96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:13.089546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2265b3f-5fc3-4df4-8915-d4028d4da96b service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:13.089794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2265b3f-5fc3-4df4-8915-d4028d4da96b service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:13.090096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2265b3f-5fc3-4df4-8915-d4028d4da96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:13.091751 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f2265b3f-5fc3-4df4-8915-d4028d4da96b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:13.212481 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2265b3f-5fc3-4df4-8915-d4028d4da96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:13.213814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2265b3f-5fc3-4df4-8915-d4028d4da96b service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:13.233627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 659/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:16.166239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fb3f1-126e-4c4a-8a8e-fd0b62f3c2bb None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:16.166757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fb3f1-126e-4c4a-8a8e-fd0b62f3c2bb None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:16.166757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fb3f1-126e-4c4a-8a8e-fd0b62f3c2bb None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:16.168600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 661/1320] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:16.174623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cf78c-684e-4608-80bb-19186f221445 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:16.175125 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cf78c-684e-4608-80bb-19186f221445 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:16.175226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cf78c-684e-4608-80bb-19186f221445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:16.240732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3b2cf78c-684e-4608-80bb-19186f221445 None None] MFA Rules not processed for user `0c7219524d1b4afd8d1aea23de18a164`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:16.241988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3b2cf78c-684e-4608-80bb-19186f221445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:16.339345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 660/1321] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:16.381437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fb3f1-126e-4c4a-8a8e-fd0b62f3c2bb None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:16.383145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d06fb3f1-126e-4c4a-8a8e-fd0b62f3c2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:16.494370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fb3f1-126e-4c4a-8a8e-fd0b62f3c2bb None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:16.569160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cbe95-1cb1-4939-8c0e-e4ba3ebb4750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:16.569879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cbe95-1cb1-4939-8c0e-e4ba3ebb4750 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:16.570211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cbe95-1cb1-4939-8c0e-e4ba3ebb4750 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:16.570475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cbe95-1cb1-4939-8c0e-e4ba3ebb4750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:16.572128 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d63cbe95-1cb1-4939-8c0e-e4ba3ebb4750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:16.688683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cbe95-1cb1-4939-8c0e-e4ba3ebb4750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:16.690175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cbe95-1cb1-4939-8c0e-e4ba3ebb4750 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:16.708323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 662/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:19.711848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdcb63-7d41-4fa5-acd1-fa491e29b69f None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:19.712493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdcb63-7d41-4fa5-acd1-fa491e29b69f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:19.712493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdcb63-7d41-4fa5-acd1-fa491e29b69f None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:19.714357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 661/1323] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:19.720544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039591d-3c13-4c5d-908d-7071a45479fa None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:19.721410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039591d-3c13-4c5d-908d-7071a45479fa None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:19.721410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039591d-3c13-4c5d-908d-7071a45479fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:19.802945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6039591d-3c13-4c5d-908d-7071a45479fa None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:19.804163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6039591d-3c13-4c5d-908d-7071a45479fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:19.904905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 663/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:19.944150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdcb63-7d41-4fa5-acd1-fa491e29b69f None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:19.945725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-fbbdcb63-7d41-4fa5-acd1-fa491e29b69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:20.080405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdcb63-7d41-4fa5-acd1-fa491e29b69f None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:20.157284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599636c4-027b-444b-b815-a3915094dae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:20.157968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599636c4-027b-444b-b815-a3915094dae4 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:20.158243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599636c4-027b-444b-b815-a3915094dae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:20.158509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599636c4-027b-444b-b815-a3915094dae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:20.160192 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-599636c4-027b-444b-b815-a3915094dae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:20.293589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599636c4-027b-444b-b815-a3915094dae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:20.295202 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599636c4-027b-444b-b815-a3915094dae4 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:20.317649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 662/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:23.441567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a0eab-b097-461b-a521-7a1ff5b90884 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:23.442617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a0eab-b097-461b-a521-7a1ff5b90884 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:23.442617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a0eab-b097-461b-a521-7a1ff5b90884 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:23.444094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 664/1326] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:23.456566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29aa5-cd63-4f72-af3d-fe5f93fa2422 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:23.457139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29aa5-cd63-4f72-af3d-fe5f93fa2422 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:23.457139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29aa5-cd63-4f72-af3d-fe5f93fa2422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:23.530741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6ff29aa5-cd63-4f72-af3d-fe5f93fa2422 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:23.532064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6ff29aa5-cd63-4f72-af3d-fe5f93fa2422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:23.643498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 663/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:45:23.680719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a0eab-b097-461b-a521-7a1ff5b90884 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:23.682510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-298a0eab-b097-461b-a521-7a1ff5b90884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:23.821287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a0eab-b097-461b-a521-7a1ff5b90884 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:23.910723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1abd83-6522-4636-961e-a1be51b9b141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:23.911389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1abd83-6522-4636-961e-a1be51b9b141 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:23.911692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1abd83-6522-4636-961e-a1be51b9b141 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:23.911936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1abd83-6522-4636-961e-a1be51b9b141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:23.913691 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cd1abd83-6522-4636-961e-a1be51b9b141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:24.043265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1abd83-6522-4636-961e-a1be51b9b141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:24.044728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1abd83-6522-4636-961e-a1be51b9b141 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:24.065612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 665/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:26.549436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b745c-f4cc-45c0-929a-39407d026e36 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:26.550068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b745c-f4cc-45c0-929a-39407d026e36 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:26.550068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b745c-f4cc-45c0-929a-39407d026e36 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:26.551845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 664/1329] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:26.557624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04689f-a8b9-4b77-a2dc-be10558aec75 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:26.558214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04689f-a8b9-4b77-a2dc-be10558aec75 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:26.558214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04689f-a8b9-4b77-a2dc-be10558aec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:26.642392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-1d04689f-a8b9-4b77-a2dc-be10558aec75 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:26.642392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1d04689f-a8b9-4b77-a2dc-be10558aec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:26.746748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 666/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:26.784387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b745c-f4cc-45c0-929a-39407d026e36 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:26.786557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-944b745c-f4cc-45c0-929a-39407d026e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:26.905075 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b745c-f4cc-45c0-929a-39407d026e36 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:26.988778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfb4c5-0444-4c7b-a0a6-5a50c11a5a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:26.989546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfb4c5-0444-4c7b-a0a6-5a50c11a5a61 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:26.989962 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfb4c5-0444-4c7b-a0a6-5a50c11a5a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:26.990417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfb4c5-0444-4c7b-a0a6-5a50c11a5a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:26.992554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9bcfb4c5-0444-4c7b-a0a6-5a50c11a5a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:27.117909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfb4c5-0444-4c7b-a0a6-5a50c11a5a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:27.119492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfb4c5-0444-4c7b-a0a6-5a50c11a5a61 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:27.137888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 665/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:29.579276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702eaf4-9746-4012-ac15-0d8b1d06c120 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:29.580213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702eaf4-9746-4012-ac15-0d8b1d06c120 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:29.580213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702eaf4-9746-4012-ac15-0d8b1d06c120 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:29.581973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 667/1332] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:29.587735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a862-d906-4709-8750-8c763843ebc4 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:29.588299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a862-d906-4709-8750-8c763843ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:29.588299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a862-d906-4709-8750-8c763843ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:29.664558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9780a862-d906-4709-8750-8c763843ebc4 None None] MFA Rules not processed for user `0c7219524d1b4afd8d1aea23de18a164`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:29.665781 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9780a862-d906-4709-8750-8c763843ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:29.780276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 666/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:29.820374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702eaf4-9746-4012-ac15-0d8b1d06c120 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:29.823250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b702eaf4-9746-4012-ac15-0d8b1d06c120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:29.964413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702eaf4-9746-4012-ac15-0d8b1d06c120 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:30.044852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3426a-b808-4352-9f37-34e9a7b3fa45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:30.045641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3426a-b808-4352-9f37-34e9a7b3fa45 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:30.046107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3426a-b808-4352-9f37-34e9a7b3fa45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:30.046384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3426a-b808-4352-9f37-34e9a7b3fa45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:30.048101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-32a3426a-b808-4352-9f37-34e9a7b3fa45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:30.161284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3426a-b808-4352-9f37-34e9a7b3fa45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:30.162721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3426a-b808-4352-9f37-34e9a7b3fa45 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:30.181006 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 668/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:32.783650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede385bb-746b-42f3-af96-165c1b1a9237 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:32.784223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede385bb-746b-42f3-af96-165c1b1a9237 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:32.784223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede385bb-746b-42f3-af96-165c1b1a9237 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:32.786104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 667/1335] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:32.791772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21fa41-2ccc-4a93-ae70-b0ebee42d694 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:32.792269 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21fa41-2ccc-4a93-ae70-b0ebee42d694 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:32.792361 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21fa41-2ccc-4a93-ae70-b0ebee42d694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:32.863677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fc21fa41-2ccc-4a93-ae70-b0ebee42d694 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:32.864896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fc21fa41-2ccc-4a93-ae70-b0ebee42d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:32.983855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 669/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:45:33.021557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede385bb-746b-42f3-af96-165c1b1a9237 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:33.023195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ede385bb-746b-42f3-af96-165c1b1a9237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:33.138065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede385bb-746b-42f3-af96-165c1b1a9237 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:33.225659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e774f15-f9ad-423c-bbd6-da0256aeb4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:33.226377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e774f15-f9ad-423c-bbd6-da0256aeb4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:33.226654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e774f15-f9ad-423c-bbd6-da0256aeb4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:33.226931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e774f15-f9ad-423c-bbd6-da0256aeb4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:33.228663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2e774f15-f9ad-423c-bbd6-da0256aeb4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:33.377732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e774f15-f9ad-423c-bbd6-da0256aeb4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:33.379346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e774f15-f9ad-423c-bbd6-da0256aeb4f9 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:33.401149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 668/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:35.865637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090c517-8262-4a4c-8c04-85db3919c4fc None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:35.866305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090c517-8262-4a4c-8c04-85db3919c4fc None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:35.866305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090c517-8262-4a4c-8c04-85db3919c4fc None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:35.868267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 670/1338] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:35.874843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484368ed-a984-4bf4-8af5-97d38a761dd1 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:35.875433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484368ed-a984-4bf4-8af5-97d38a761dd1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:35.875433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484368ed-a984-4bf4-8af5-97d38a761dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:35.948922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-484368ed-a984-4bf4-8af5-97d38a761dd1 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:35.950088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-484368ed-a984-4bf4-8af5-97d38a761dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:36.062908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 669/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:45:36.105443 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090c517-8262-4a4c-8c04-85db3919c4fc None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:36.109356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b090c517-8262-4a4c-8c04-85db3919c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:36.239365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090c517-8262-4a4c-8c04-85db3919c4fc None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:36.245198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079a208-3004-4cdd-8f33-b47aaab1b388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:36.246354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079a208-3004-4cdd-8f33-b47aaab1b388 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:36.247342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079a208-3004-4cdd-8f33-b47aaab1b388 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:36.247845 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079a208-3004-4cdd-8f33-b47aaab1b388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:36.250930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4079a208-3004-4cdd-8f33-b47aaab1b388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:36.398538 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079a208-3004-4cdd-8f33-b47aaab1b388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:36.401388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079a208-3004-4cdd-8f33-b47aaab1b388 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:36.435089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 671/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:45:39.278631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ab669-49fe-4b33-9342-6945cc0ee8a5 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:39.279278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ab669-49fe-4b33-9342-6945cc0ee8a5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:39.279278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ab669-49fe-4b33-9342-6945cc0ee8a5 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:39.281184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 670/1341] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:39.287244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ebf2-771f-429c-b7d4-3f79fa259b2a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:39.287797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ebf2-771f-429c-b7d4-3f79fa259b2a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:39.287797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ebf2-771f-429c-b7d4-3f79fa259b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:39.340235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e597ebf2-771f-429c-b7d4-3f79fa259b2a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:39.341492 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e597ebf2-771f-429c-b7d4-3f79fa259b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:39.431480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 672/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:39.468827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ab669-49fe-4b33-9342-6945cc0ee8a5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:39.471728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-741ab669-49fe-4b33-9342-6945cc0ee8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:39.489820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ab669-49fe-4b33-9342-6945cc0ee8a5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:39.494061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037bf07-f614-4037-9fa7-8675cddc8726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:39.494809 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037bf07-f614-4037-9fa7-8675cddc8726 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:39.495139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037bf07-f614-4037-9fa7-8675cddc8726 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:39.495478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037bf07-f614-4037-9fa7-8675cddc8726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:39.508624 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037bf07-f614-4037-9fa7-8675cddc8726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:39.510224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037bf07-f614-4037-9fa7-8675cddc8726 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:39.521321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 671/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:44.662629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a931ae-4082-497e-8f5a-07c102de90e8 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:44.663214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a931ae-4082-497e-8f5a-07c102de90e8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:44.663214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a931ae-4082-497e-8f5a-07c102de90e8 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:44.664981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 673/1344] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:45:44.670618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900cea9-075a-478a-848a-80d84433fce7 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:44.671143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900cea9-075a-478a-848a-80d84433fce7 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:44.671143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900cea9-075a-478a-848a-80d84433fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:44.699422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b900cea9-075a-478a-848a-80d84433fce7 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:44.700608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b900cea9-075a-478a-848a-80d84433fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:44.709076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 672/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:44.749055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a931ae-4082-497e-8f5a-07c102de90e8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:44.760803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a931ae-4082-497e-8f5a-07c102de90e8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:44.765217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92ec7f-ae81-410b-8a63-db68e990a4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:44.766188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ec7f-ae81-410b-8a63-db68e990a4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:44.766474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ec7f-ae81-410b-8a63-db68e990a4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:44.766747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ec7f-ae81-410b-8a63-db68e990a4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:44.779475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92ec7f-ae81-410b-8a63-db68e990a4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:44.781308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92ec7f-ae81-410b-8a63-db68e990a4a2 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:44.791468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 674/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:45:47.891424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91926a08-1e3f-4bff-9a60-862aea6553e7 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:47.892288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91926a08-1e3f-4bff-9a60-862aea6553e7 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:47.892288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91926a08-1e3f-4bff-9a60-862aea6553e7 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:47.894509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 673/1347] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:45:47.901179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc5da-4892-4f63-8c0f-3a771dcb4e3a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:47.901749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc5da-4892-4f63-8c0f-3a771dcb4e3a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:47.902875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc5da-4892-4f63-8c0f-3a771dcb4e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:47.932637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-ec7cc5da-4892-4f63-8c0f-3a771dcb4e3a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:47.934673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ec7cc5da-4892-4f63-8c0f-3a771dcb4e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:47.947904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 675/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:47.986570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91926a08-1e3f-4bff-9a60-862aea6553e7 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:47.998230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91926a08-1e3f-4bff-9a60-862aea6553e7 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:48.002137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f10c3f-6d4c-48d7-a83c-d011f0447e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:48.002900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f10c3f-6d4c-48d7-a83c-d011f0447e2d service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:48.003370 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f10c3f-6d4c-48d7-a83c-d011f0447e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:48.003755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f10c3f-6d4c-48d7-a83c-d011f0447e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:48.015924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f10c3f-6d4c-48d7-a83c-d011f0447e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:48.018338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f10c3f-6d4c-48d7-a83c-d011f0447e2d service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:48.030322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 674/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:45:52.702229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b85db-8817-4698-8e74-75ac655d286d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:52.702634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b85db-8817-4698-8e74-75ac655d286d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:52.702741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b85db-8817-4698-8e74-75ac655d286d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:52.704545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 676/1350] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:52.710534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da758d-0f9a-451f-857e-8021b26f9875 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:52.711630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da758d-0f9a-451f-857e-8021b26f9875 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:52.712113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da758d-0f9a-451f-857e-8021b26f9875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:52.734315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-07da758d-0f9a-451f-857e-8021b26f9875 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:52.735631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-07da758d-0f9a-451f-857e-8021b26f9875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:52.749913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 675/1351] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:45:52.789360 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b85db-8817-4698-8e74-75ac655d286d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:45:52.802081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b85db-8817-4698-8e74-75ac655d286d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:45:52.807491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a121f-869e-4673-b3d8-ada9b563ca35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:45:52.808154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a121f-869e-4673-b3d8-ada9b563ca35 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:52.808437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a121f-869e-4673-b3d8-ada9b563ca35 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:52.808709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a121f-869e-4673-b3d8-ada9b563ca35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:52.819248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a121f-869e-4673-b3d8-ada9b563ca35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:45:52.820707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a121f-869e-4673-b3d8-ada9b563ca35 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:45:52.831422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 677/1352] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:45:58.975832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b6a3-4e8e-4298-8fd4-5365fa6210b2 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:58.979021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b6a3-4e8e-4298-8fd4-5365fa6210b2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:58.980811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b6a3-4e8e-4298-8fd4-5365fa6210b2 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:58.986290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 676/1353] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 19:45:58 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:45:58.995389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405652e0-7d84-4055-bdf5-a387d72fae33 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:45:58.996205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405652e0-7d84-4055-bdf5-a387d72fae33 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:45:58.996205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405652e0-7d84-4055-bdf5-a387d72fae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:45:59.111963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-405652e0-7d84-4055-bdf5-a387d72fae33 None None] MFA Rules not processed for user `eed3ec40f28c4bc990d8f56466889aff`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:45:59.113344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-405652e0-7d84-4055-bdf5-a387d72fae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:45:59.203663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 678/1354] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 19:45:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:46:04.313541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c0321-ebea-4c16-815f-d7dd84b9c40c None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:04.314226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c0321-ebea-4c16-815f-d7dd84b9c40c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:04.314226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c0321-ebea-4c16-815f-d7dd84b9c40c None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:04.316324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 677/1355] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 19:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:46:04.321790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817a42f-f257-4f98-b2fa-30d87d90bc56 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:04.322653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817a42f-f257-4f98-b2fa-30d87d90bc56 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:04.322653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817a42f-f257-4f98-b2fa-30d87d90bc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:04.345099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4817a42f-f257-4f98-b2fa-30d87d90bc56 None None] MFA Rules not processed for user `eed3ec40f28c4bc990d8f56466889aff`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:04.346742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4817a42f-f257-4f98-b2fa-30d87d90bc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:04.361864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 679/1356] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 19:46:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:06.205913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b0b1-083f-44b8-9ec2-4a1d8a1fa3c3 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:06.206838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b0b1-083f-44b8-9ec2-4a1d8a1fa3c3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:06.206972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b0b1-083f-44b8-9ec2-4a1d8a1fa3c3 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:06.210167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 678/1357] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 19:46:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:06.216387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd13d4-ba56-4e54-861f-f21c107dde5b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:06.217054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd13d4-ba56-4e54-861f-f21c107dde5b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:06.217054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd13d4-ba56-4e54-861f-f21c107dde5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:06.244982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a1cd13d4-ba56-4e54-861f-f21c107dde5b None None] MFA Rules not processed for user `eed3ec40f28c4bc990d8f56466889aff`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:06.246324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a1cd13d4-ba56-4e54-861f-f21c107dde5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:06.258305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 680/1358] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 19:46:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:10.226082 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997d040-f353-4d5d-aa3c-ffc068108279 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:10.226917 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997d040-f353-4d5d-aa3c-ffc068108279 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:10.226917 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997d040-f353-4d5d-aa3c-ffc068108279 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:10.232408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 679/1359] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:10.234863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6db0c-f18f-4c70-bc4e-45c804b91d83 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:10.236719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6db0c-f18f-4c70-bc4e-45c804b91d83 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:10.237231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6db0c-f18f-4c70-bc4e-45c804b91d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:10.261236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c6e6db0c-f18f-4c70-bc4e-45c804b91d83 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:10.262958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c6e6db0c-f18f-4c70-bc4e-45c804b91d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:10.278381 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 681/1360] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:10.337221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb881-d8f6-4a33-8661-947b6696dcb6 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:10.337692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb881-d8f6-4a33-8661-947b6696dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:10.338254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb881-d8f6-4a33-8661-947b6696dcb6 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:10.341812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 680/1361] 10.222.0.49 () {54 vars in 959 bytes} [Tue Mar 22 19:46:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:10.354152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd54e-430b-4594-9e69-9ef011d37014 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:10.354485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd54e-430b-4594-9e69-9ef011d37014 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:10.354827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dd54e-430b-4594-9e69-9ef011d37014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:10.421890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-5c7dd54e-430b-4594-9e69-9ef011d37014 None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:10.423760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5c7dd54e-430b-4594-9e69-9ef011d37014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:10.512055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 682/1362] 10.222.0.49 () {58 vars in 1056 bytes} [Tue Mar 22 19:46:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:10.521702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fb881-d8f6-4a33-8661-947b6696dcb6 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:10.537960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fb881-d8f6-4a33-8661-947b6696dcb6 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:10.550970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38c43-cd82-44a7-81cc-e17afe9f3713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:10.551731 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38c43-cd82-44a7-81cc-e17afe9f3713 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:10.552088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38c43-cd82-44a7-81cc-e17afe9f3713 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:10.552426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38c43-cd82-44a7-81cc-e17afe9f3713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:10.563008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d38c43-cd82-44a7-81cc-e17afe9f3713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:10.564720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d38c43-cd82-44a7-81cc-e17afe9f3713 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:10.577151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 681/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:46:13.488021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4db45-c0c7-41fe-8612-6297099295bd None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:13.488654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4db45-c0c7-41fe-8612-6297099295bd None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:13.488903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4db45-c0c7-41fe-8612-6297099295bd None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:13.494354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 683/1364] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:13.499924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1892f-ae29-41f1-bb26-c6776a8c0e87 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:13.500678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1892f-ae29-41f1-bb26-c6776a8c0e87 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:13.500678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1892f-ae29-41f1-bb26-c6776a8c0e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:13.521159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-32d1892f-ae29-41f1-bb26-c6776a8c0e87 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:13.522730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-32d1892f-ae29-41f1-bb26-c6776a8c0e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:13.533596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 682/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:13.579404 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4db45-c0c7-41fe-8612-6297099295bd None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:13.598520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4db45-c0c7-41fe-8612-6297099295bd None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:13.605251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65baad3-4b5d-48e6-b5a8-3ef0d54d6d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:13.605787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65baad3-4b5d-48e6-b5a8-3ef0d54d6d34 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:13.606187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65baad3-4b5d-48e6-b5a8-3ef0d54d6d34 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:13.606604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65baad3-4b5d-48e6-b5a8-3ef0d54d6d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:13.618407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65baad3-4b5d-48e6-b5a8-3ef0d54d6d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:13.620568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65baad3-4b5d-48e6-b5a8-3ef0d54d6d34 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:13.633576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 684/1366] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:46:16.411789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feecb67-1c7c-4793-98f8-cad63895d4f5 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:16.412793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feecb67-1c7c-4793-98f8-cad63895d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:16.412793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feecb67-1c7c-4793-98f8-cad63895d4f5 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:16.414263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 683/1367] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:46:16.420563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f61a3-b9a0-47b7-9519-ab185d1d6fc0 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:16.421135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f61a3-b9a0-47b7-9519-ab185d1d6fc0 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:16.421135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f61a3-b9a0-47b7-9519-ab185d1d6fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:16.442904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-da2f61a3-b9a0-47b7-9519-ab185d1d6fc0 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:16.444268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-da2f61a3-b9a0-47b7-9519-ab185d1d6fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:16.457369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 685/1368] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:16.536589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa282c-5f82-4f6e-ab71-942d636b1f1c None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:16.536873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa282c-5f82-4f6e-ab71-942d636b1f1c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:16.537141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa282c-5f82-4f6e-ab71-942d636b1f1c None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:16.538976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 684/1369] 10.222.0.49 () {54 vars in 959 bytes} [Tue Mar 22 19:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:46:16.549679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c6563-cc8e-420d-96a1-2158a781c6f8 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:16.550296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c6563-cc8e-420d-96a1-2158a781c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:16.550587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c6563-cc8e-420d-96a1-2158a781c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:16.570754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-526c6563-cc8e-420d-96a1-2158a781c6f8 None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:16.572040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-526c6563-cc8e-420d-96a1-2158a781c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:16.589423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 686/1370] 10.222.0.49 () {58 vars in 1056 bytes} [Tue Mar 22 19:46:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:16.598564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa282c-5f82-4f6e-ab71-942d636b1f1c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:16.620927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa282c-5f82-4f6e-ab71-942d636b1f1c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:16.628660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427477d7-2f66-47a5-a154-4c0cf6b16653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:16.629905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427477d7-2f66-47a5-a154-4c0cf6b16653 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:16.630533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427477d7-2f66-47a5-a154-4c0cf6b16653 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:16.631113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427477d7-2f66-47a5-a154-4c0cf6b16653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:16.646068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427477d7-2f66-47a5-a154-4c0cf6b16653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:16.647773 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427477d7-2f66-47a5-a154-4c0cf6b16653 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:16.660972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 685/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:46:19.401764 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c2bc0-b312-478b-8403-a21c686a4901 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:19.402597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c2bc0-b312-478b-8403-a21c686a4901 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:19.403055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c2bc0-b312-478b-8403-a21c686a4901 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:19.407195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 687/1372] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:19.413043 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224996af-37d7-4756-b681-3d9b9e7b6b37 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:19.413998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224996af-37d7-4756-b681-3d9b9e7b6b37 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:19.414407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224996af-37d7-4756-b681-3d9b9e7b6b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:19.440091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-224996af-37d7-4756-b681-3d9b9e7b6b37 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:19.441595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-224996af-37d7-4756-b681-3d9b9e7b6b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:19.449992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 686/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:19.505404 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c2bc0-b312-478b-8403-a21c686a4901 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:19.528694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c2bc0-b312-478b-8403-a21c686a4901 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:19.534864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111055de-bede-404d-86db-443e48cc226e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:19.535496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111055de-bede-404d-86db-443e48cc226e service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:19.535794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111055de-bede-404d-86db-443e48cc226e service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:19.536068 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111055de-bede-404d-86db-443e48cc226e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:19.550183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111055de-bede-404d-86db-443e48cc226e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:19.553150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111055de-bede-404d-86db-443e48cc226e service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:19.567863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 688/1374] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:46:19.635872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f19d-81e9-4f89-ac55-bc687d7d8ae5 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:19.636420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f19d-81e9-4f89-ac55-bc687d7d8ae5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:19.637097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f19d-81e9-4f89-ac55-bc687d7d8ae5 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:19.641024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 687/1375] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:19.647257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae3884-174a-4b27-aaa7-5e780084443b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:19.647540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae3884-174a-4b27-aaa7-5e780084443b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:19.647834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae3884-174a-4b27-aaa7-5e780084443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:19.669705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d1ae3884-174a-4b27-aaa7-5e780084443b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:19.671144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d1ae3884-174a-4b27-aaa7-5e780084443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:19.680488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 689/1376] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:20.056600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8680aeb-0d77-41d1-88ab-fbc6cfbc9972 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:20.057211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8680aeb-0d77-41d1-88ab-fbc6cfbc9972 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:20.057658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8680aeb-0d77-41d1-88ab-fbc6cfbc9972 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:20.060497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 688/1377] 10.222.0.49 () {54 vars in 962 bytes} [Tue Mar 22 19:46:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:46:20.071684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6a93-fcf9-49ee-a090-06f740b665ed None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:20.072146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6a93-fcf9-49ee-a090-06f740b665ed None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:20.072613 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6a93-fcf9-49ee-a090-06f740b665ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:20.137732 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-99fc6a93-fcf9-49ee-a090-06f740b665ed None None] MFA Rules not processed for user `908e60013ebe4372a803a2ae5223e2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:20.139863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-99fc6a93-fcf9-49ee-a090-06f740b665ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:20.246430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 690/1378] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Mar 22 19:46:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:20.257460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8680aeb-0d77-41d1-88ab-fbc6cfbc9972 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:20.276862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8680aeb-0d77-41d1-88ab-fbc6cfbc9972 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:20.283218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baacf0-3505-484d-a6f3-59e55e811a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:20.283866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baacf0-3505-484d-a6f3-59e55e811a8c service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:20.284398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baacf0-3505-484d-a6f3-59e55e811a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:20.284661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baacf0-3505-484d-a6f3-59e55e811a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:20.295431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baacf0-3505-484d-a6f3-59e55e811a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:20.297816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baacf0-3505-484d-a6f3-59e55e811a8c service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:20.308739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 689/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:46:22.104733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e2d44-dc25-4214-9666-7ac902b885c7 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:22.105397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e2d44-dc25-4214-9666-7ac902b885c7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:22.105857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e2d44-dc25-4214-9666-7ac902b885c7 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:22.109601 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 691/1380] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:22.115614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c6bef-d9eb-4063-9ed2-9fa922455804 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:22.116164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c6bef-d9eb-4063-9ed2-9fa922455804 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:22.116164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c6bef-d9eb-4063-9ed2-9fa922455804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:22.140567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c28c6bef-d9eb-4063-9ed2-9fa922455804 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:22.141900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c28c6bef-d9eb-4063-9ed2-9fa922455804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:22.151340 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 690/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:46:22.197445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e2d44-dc25-4214-9666-7ac902b885c7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:22.213535 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e2d44-dc25-4214-9666-7ac902b885c7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:22.222127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a533f-e5eb-40fd-b40f-f41a53d39b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:22.222895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a533f-e5eb-40fd-b40f-f41a53d39b94 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:22.223179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a533f-e5eb-40fd-b40f-f41a53d39b94 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:22.223471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a533f-e5eb-40fd-b40f-f41a53d39b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:22.233158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a533f-e5eb-40fd-b40f-f41a53d39b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:22.234833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a533f-e5eb-40fd-b40f-f41a53d39b94 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:22.245128 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 692/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:46:24.882590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca0ae-c64c-4837-9d40-da21a7f55de4 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:24.883207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca0ae-c64c-4837-9d40-da21a7f55de4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:24.883610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca0ae-c64c-4837-9d40-da21a7f55de4 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:24.887207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 691/1383] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:24.897547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55bde1-ea7f-4e26-b25a-e7d9699ac750 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:24.898520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55bde1-ea7f-4e26-b25a-e7d9699ac750 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:24.898520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55bde1-ea7f-4e26-b25a-e7d9699ac750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:24.921412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-3b55bde1-ea7f-4e26-b25a-e7d9699ac750 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:24.922634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3b55bde1-ea7f-4e26-b25a-e7d9699ac750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:24.931075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 693/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:24.985091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca0ae-c64c-4837-9d40-da21a7f55de4 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:25.013918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca0ae-c64c-4837-9d40-da21a7f55de4 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:25.024810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ffddb-96a1-47e0-a3e8-02fddb43b64d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:25.026034 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ffddb-96a1-47e0-a3e8-02fddb43b64d service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:25.026514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ffddb-96a1-47e0-a3e8-02fddb43b64d service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:25.027001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ffddb-96a1-47e0-a3e8-02fddb43b64d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:25.040222 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ffddb-96a1-47e0-a3e8-02fddb43b64d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:25.051162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ffddb-96a1-47e0-a3e8-02fddb43b64d service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:25.074196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 692/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:46:27.654040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d1d0f-4421-4b2e-9330-0c159da06e62 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:27.655129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d1d0f-4421-4b2e-9330-0c159da06e62 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:27.655712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d1d0f-4421-4b2e-9330-0c159da06e62 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:27.658752 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 694/1386] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:27.664751 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d76ad7-f3ee-4a82-bdc2-4192be065475 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:27.665672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d76ad7-f3ee-4a82-bdc2-4192be065475 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:27.665977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d76ad7-f3ee-4a82-bdc2-4192be065475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:27.686737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-75d76ad7-f3ee-4a82-bdc2-4192be065475 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:27.688012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-75d76ad7-f3ee-4a82-bdc2-4192be065475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:27.697708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 693/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:27.751750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d1d0f-4421-4b2e-9330-0c159da06e62 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:27.776947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d1d0f-4421-4b2e-9330-0c159da06e62 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:27.786921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686bafd-cb90-4324-9144-bbaaa009f542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:27.788127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686bafd-cb90-4324-9144-bbaaa009f542 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:27.788731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686bafd-cb90-4324-9144-bbaaa009f542 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:27.789310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686bafd-cb90-4324-9144-bbaaa009f542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:27.804438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686bafd-cb90-4324-9144-bbaaa009f542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:27.807546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686bafd-cb90-4324-9144-bbaaa009f542 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:27.823743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 695/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:46:30.271822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e8102-6b6b-4d4c-bd17-38070082506e None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:30.272876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e8102-6b6b-4d4c-bd17-38070082506e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:30.272876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e8102-6b6b-4d4c-bd17-38070082506e None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:30.274091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 694/1389] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:30.284388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1390680-40b1-4393-8935-f0da680bdc84 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:30.285265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1390680-40b1-4393-8935-f0da680bdc84 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:30.285575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1390680-40b1-4393-8935-f0da680bdc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:30.312774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a1390680-40b1-4393-8935-f0da680bdc84 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:30.314385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a1390680-40b1-4393-8935-f0da680bdc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:30.324663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 696/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:30.385463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e8102-6b6b-4d4c-bd17-38070082506e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:30.410196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e8102-6b6b-4d4c-bd17-38070082506e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:30.418248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ac1f0-aefe-419c-a116-5562f82d896b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:30.419061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ac1f0-aefe-419c-a116-5562f82d896b service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:30.419353 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ac1f0-aefe-419c-a116-5562f82d896b service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:30.419828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ac1f0-aefe-419c-a116-5562f82d896b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:30.429765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ac1f0-aefe-419c-a116-5562f82d896b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:30.431492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ac1f0-aefe-419c-a116-5562f82d896b service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:30.443887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 695/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:46:32.888161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905acf4-94b3-4f8b-8c9c-563a728a995a None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:32.888784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905acf4-94b3-4f8b-8c9c-563a728a995a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:32.889407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905acf4-94b3-4f8b-8c9c-563a728a995a None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:32.892706 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 697/1392] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:32.898982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14677ddc-693d-468e-803e-3d56030302c6 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:32.899531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14677ddc-693d-468e-803e-3d56030302c6 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:32.899654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14677ddc-693d-468e-803e-3d56030302c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:32.920316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-14677ddc-693d-468e-803e-3d56030302c6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:32.922231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-14677ddc-693d-468e-803e-3d56030302c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:32.934490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 696/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:32.983054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905acf4-94b3-4f8b-8c9c-563a728a995a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:33.001612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905acf4-94b3-4f8b-8c9c-563a728a995a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:33.008301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53409743-b356-4748-9c20-83def6396c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:33.009017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53409743-b356-4748-9c20-83def6396c05 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:33.009326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53409743-b356-4748-9c20-83def6396c05 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:33.009610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53409743-b356-4748-9c20-83def6396c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:33.020514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53409743-b356-4748-9c20-83def6396c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:33.022387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53409743-b356-4748-9c20-83def6396c05 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:33.041260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 698/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:46:35.843588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf10b85-4d86-44cb-90d3-82dcb4e5370c None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:35.844183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf10b85-4d86-44cb-90d3-82dcb4e5370c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:35.844183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf10b85-4d86-44cb-90d3-82dcb4e5370c None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:35.846340 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 697/1395] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:35.851769 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb6c8e-011a-4c80-a268-7b30812c7d3c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:35.852297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb6c8e-011a-4c80-a268-7b30812c7d3c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:35.852405 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb6c8e-011a-4c80-a268-7b30812c7d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:35.873244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-8fcb6c8e-011a-4c80-a268-7b30812c7d3c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:35.874488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-8fcb6c8e-011a-4c80-a268-7b30812c7d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:35.882745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 699/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:46:35.927171 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf10b85-4d86-44cb-90d3-82dcb4e5370c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:35.942341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf10b85-4d86-44cb-90d3-82dcb4e5370c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:35.948732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e980198-6bdb-4a5d-8b85-5d3ebaa737e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:35.949718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e980198-6bdb-4a5d-8b85-5d3ebaa737e4 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:35.950034 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e980198-6bdb-4a5d-8b85-5d3ebaa737e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:35.950364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e980198-6bdb-4a5d-8b85-5d3ebaa737e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:35.961653 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e980198-6bdb-4a5d-8b85-5d3ebaa737e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:35.963468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e980198-6bdb-4a5d-8b85-5d3ebaa737e4 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:35.975606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 698/1397] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:46:37.383353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c80eaa-5d42-49f5-a8fd-fd577141b641 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:37.383899 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c80eaa-5d42-49f5-a8fd-fd577141b641 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:37.384018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c80eaa-5d42-49f5-a8fd-fd577141b641 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:37.386418 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 700/1398] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:37.392963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aca41-78d4-4966-9a42-1c3459120649 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:37.394035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aca41-78d4-4966-9a42-1c3459120649 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:37.394347 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aca41-78d4-4966-9a42-1c3459120649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:37.413456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-de1aca41-78d4-4966-9a42-1c3459120649 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:37.414714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-de1aca41-78d4-4966-9a42-1c3459120649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:37.423815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 699/1399] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:37.482868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa254b-f3c4-45b3-8a56-9f9329eeaa1d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:37.483282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa254b-f3c4-45b3-8a56-9f9329eeaa1d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:37.483700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa254b-f3c4-45b3-8a56-9f9329eeaa1d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:37.485743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 701/1400] 10.222.0.49 () {54 vars in 961 bytes} [Tue Mar 22 19:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:37.491304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5e8e0-0b12-4ba6-b97d-278265cab50d None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:37.491622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5e8e0-0b12-4ba6-b97d-278265cab50d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:37.491891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5e8e0-0b12-4ba6-b97d-278265cab50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:37.543946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-41f5e8e0-0b12-4ba6-b97d-278265cab50d None None] MFA Rules not processed for user `02aff559435a445db07636197a534f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:37.545151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-41f5e8e0-0b12-4ba6-b97d-278265cab50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:37.606734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 700/1401] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Mar 22 19:46:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:37.614341 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa254b-f3c4-45b3-8a56-9f9329eeaa1d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:37.627226 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa254b-f3c4-45b3-8a56-9f9329eeaa1d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:37.631225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e794c84-fd4e-4296-a2ac-a638dc1c3093 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:37.632315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794c84-fd4e-4296-a2ac-a638dc1c3093 service glance] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:37.632805 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794c84-fd4e-4296-a2ac-a638dc1c3093 service glance] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:37.633305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794c84-fd4e-4296-a2ac-a638dc1c3093 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:37.644118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794c84-fd4e-4296-a2ac-a638dc1c3093 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:37.645485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794c84-fd4e-4296-a2ac-a638dc1c3093 service glance] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:37.655987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 702/1402] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:46:38.086795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03201d2-3f61-46b6-87bf-988eb55e0bb4 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:38.087032 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03201d2-3f61-46b6-87bf-988eb55e0bb4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:38.087338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03201d2-3f61-46b6-87bf-988eb55e0bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:38.138832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-e03201d2-3f61-46b6-87bf-988eb55e0bb4 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:38.140046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e03201d2-3f61-46b6-87bf-988eb55e0bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:38.206491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 701/1403] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 19:46:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:38.251646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746fa5d-6a66-4390-bbd7-f93b186fedbd None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:38.251933 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746fa5d-6a66-4390-bbd7-f93b186fedbd None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:38.252207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746fa5d-6a66-4390-bbd7-f93b186fedbd None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:38.254016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 703/1404] 10.222.0.49 () {54 vars in 942 bytes} [Tue Mar 22 19:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:38.260929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6772760-961b-41fb-9ee3-579ac64855c2 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:38.261223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6772760-961b-41fb-9ee3-579ac64855c2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:38.261505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6772760-961b-41fb-9ee3-579ac64855c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:38.313613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-a6772760-961b-41fb-9ee3-579ac64855c2 None None] MFA Rules not processed for user `439b41be395d4faeae0b855a1e0f25f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:38.314826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a6772760-961b-41fb-9ee3-579ac64855c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:38.337931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5d19d-b860-4f14-a2a3-2f2928eaccf7 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:38.338343 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5d19d-b860-4f14-a2a3-2f2928eaccf7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:38.338690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5d19d-b860-4f14-a2a3-2f2928eaccf7 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:38.340755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 704/1405] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:38.346750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865436d6-e2bf-48c1-82dc-38e90509497c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:38.347036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865436d6-e2bf-48c1-82dc-38e90509497c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:38.347311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865436d6-e2bf-48c1-82dc-38e90509497c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:38.370266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-865436d6-e2bf-48c1-82dc-38e90509497c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:38.372098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-865436d6-e2bf-48c1-82dc-38e90509497c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:38.381982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 705/1406] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:38.393004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 702/1407] 10.222.0.49 () {58 vars in 1039 bytes} [Tue Mar 22 19:46:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:38.402810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865436d6-e2bf-48c1-82dc-38e90509497c None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:38.415667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865436d6-e2bf-48c1-82dc-38e90509497c None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:38.422032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c0334-90ad-4219-8182-ce506e78e9ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:38.422820 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0334-90ad-4219-8182-ce506e78e9ae service swift] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:38.423100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0334-90ad-4219-8182-ce506e78e9ae service swift] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:38.423372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0334-90ad-4219-8182-ce506e78e9ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:38.426869 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6772760-961b-41fb-9ee3-579ac64855c2 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:38.433828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c0334-90ad-4219-8182-ce506e78e9ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:38.435721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c0334-90ad-4219-8182-ce506e78e9ae service swift] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:38.439182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6772760-961b-41fb-9ee3-579ac64855c2 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:38.444123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 706/1408] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 19:46:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 19:46:38.445355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00525d86-e142-47c3-81bf-783605720d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:38.446098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00525d86-e142-47c3-81bf-783605720d4a service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:38.446310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00525d86-e142-47c3-81bf-783605720d4a service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:38.446905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00525d86-e142-47c3-81bf-783605720d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:38.456189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00525d86-e142-47c3-81bf-783605720d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:38.458144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00525d86-e142-47c3-81bf-783605720d4a service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:38.469049 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 703/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:46:40.893085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e098c0-fa07-49b7-859f-0bd3e2e5c7ff None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:40.893085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e098c0-fa07-49b7-859f-0bd3e2e5c7ff None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:40.893085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e098c0-fa07-49b7-859f-0bd3e2e5c7ff None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:40.893085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 707/1410] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:46:40.898412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510e13-b2b5-45c7-9815-6c1eeaa0f2e7 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:40.899217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510e13-b2b5-45c7-9815-6c1eeaa0f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:40.899500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510e13-b2b5-45c7-9815-6c1eeaa0f2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:40.919959 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1d510e13-b2b5-45c7-9815-6c1eeaa0f2e7 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:46:40.921191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1d510e13-b2b5-45c7-9815-6c1eeaa0f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:46:40.932018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 704/1411] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:46:40.979395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e098c0-fa07-49b7-859f-0bd3e2e5c7ff None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:46:40.995649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e098c0-fa07-49b7-859f-0bd3e2e5c7ff None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:46:41.005600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db59f02-fe80-48fd-b146-e05049690280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:46:41.006382 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db59f02-fe80-48fd-b146-e05049690280 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:46:41.006725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db59f02-fe80-48fd-b146-e05049690280 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:46:41.007054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db59f02-fe80-48fd-b146-e05049690280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:46:41.017866 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db59f02-fe80-48fd-b146-e05049690280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:46:41.019790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db59f02-fe80-48fd-b146-e05049690280 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:46:41.030598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 708/1412] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:01.796913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c53dd-256e-48b7-8f81-13a318bbaf47 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:01.797611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c53dd-256e-48b7-8f81-13a318bbaf47 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:01.797611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c53dd-256e-48b7-8f81-13a318bbaf47 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:01.799504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 705/1413] 10.222.0.49 () {54 vars in 918 bytes} [Tue Mar 22 19:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:01.805689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce02ab-c975-493c-9ae2-4a4958965d6d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:01.806351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce02ab-c975-493c-9ae2-4a4958965d6d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:01.806351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce02ab-c975-493c-9ae2-4a4958965d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:01.827681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e7ce02ab-c975-493c-9ae2-4a4958965d6d None None] MFA Rules not processed for user `eed3ec40f28c4bc990d8f56466889aff`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:01.828996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e7ce02ab-c975-493c-9ae2-4a4958965d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:01.840641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 709/1414] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Mar 22 19:47:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:01.857008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf1ca8-5259-4f40-8279-64fa65eec7c5 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:01.857298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf1ca8-5259-4f40-8279-64fa65eec7c5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:01.857442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf1ca8-5259-4f40-8279-64fa65eec7c5 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:01.859315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 706/1415] 10.222.0.49 () {54 vars in 918 bytes} [Tue Mar 22 19:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:01.864975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db8a71-76dc-4dd7-ad4f-f90e7531303b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:01.865266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db8a71-76dc-4dd7-ad4f-f90e7531303b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:01.865549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db8a71-76dc-4dd7-ad4f-f90e7531303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:01.900133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-54db8a71-76dc-4dd7-ad4f-f90e7531303b None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:01.902414 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-54db8a71-76dc-4dd7-ad4f-f90e7531303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:01.919420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 710/1416] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Mar 22 19:47:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:04.801972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35e247-bc0c-4527-908e-19636ed02df8 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:04.802586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35e247-bc0c-4527-908e-19636ed02df8 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:04.802586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35e247-bc0c-4527-908e-19636ed02df8 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:04.804361 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:04.810949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59128f7-d482-45ea-8ea4-e2c105660538 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:04.811591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59128f7-d482-45ea-8ea4-e2c105660538 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:04.811591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59128f7-d482-45ea-8ea4-e2c105660538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:04.835129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-f59128f7-d482-45ea-8ea4-e2c105660538 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:04.836506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f59128f7-d482-45ea-8ea4-e2c105660538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:04.846121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:04.895847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35e247-bc0c-4527-908e-19636ed02df8 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:04.911100 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35e247-bc0c-4527-908e-19636ed02df8 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:04.917592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd907f-a354-4bbd-8ad8-16bac72bd58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:04.918351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd907f-a354-4bbd-8ad8-16bac72bd58e service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:04.918648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd907f-a354-4bbd-8ad8-16bac72bd58e service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:04.919165 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd907f-a354-4bbd-8ad8-16bac72bd58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:04.927529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd907f-a354-4bbd-8ad8-16bac72bd58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:04.929124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd907f-a354-4bbd-8ad8-16bac72bd58e service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:04.938665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 708/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:06.385970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738dd3-8367-4cfa-8867-075e99936456 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:06.386740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738dd3-8367-4cfa-8867-075e99936456 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:06.386865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738dd3-8367-4cfa-8867-075e99936456 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:06.388647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:06.394444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02aa4-18e7-4208-8e31-7119122e4cdf None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:06.395098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02aa4-18e7-4208-8e31-7119122e4cdf None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:06.395098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd02aa4-18e7-4208-8e31-7119122e4cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:06.415068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6fd02aa4-18e7-4208-8e31-7119122e4cdf None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:06.416282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6fd02aa4-18e7-4208-8e31-7119122e4cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:06.425086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:06.630290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738dd3-8367-4cfa-8867-075e99936456 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:06.646342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738dd3-8367-4cfa-8867-075e99936456 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:06.653617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fe884-4022-4e27-a705-e5cf51ea5700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:06.654387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fe884-4022-4e27-a705-e5cf51ea5700 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:06.654873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fe884-4022-4e27-a705-e5cf51ea5700 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:06.655344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fe884-4022-4e27-a705-e5cf51ea5700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:06.665959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fe884-4022-4e27-a705-e5cf51ea5700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:06.669641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fe884-4022-4e27-a705-e5cf51ea5700 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:06.681215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 713/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:08.047353 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72484288-2f79-4ba4-a036-d24ce594a3e1 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:08.047890 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72484288-2f79-4ba4-a036-d24ce594a3e1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:08.047890 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72484288-2f79-4ba4-a036-d24ce594a3e1 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:08.049715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:47:08.055225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cf616-46c9-4201-b832-040894125d2c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:08.055730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cf616-46c9-4201-b832-040894125d2c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:08.055730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cf616-46c9-4201-b832-040894125d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:08.076214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d04cf616-46c9-4201-b832-040894125d2c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:08.077534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d04cf616-46c9-4201-b832-040894125d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:08.088050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:08.244919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72484288-2f79-4ba4-a036-d24ce594a3e1 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:08.260685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72484288-2f79-4ba4-a036-d24ce594a3e1 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:08.267398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d51c9-1dbe-495c-966c-d2dec8875874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:08.268044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d51c9-1dbe-495c-966c-d2dec8875874 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:08.268321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d51c9-1dbe-495c-966c-d2dec8875874 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:08.268602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d51c9-1dbe-495c-966c-d2dec8875874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:08.277597 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d51c9-1dbe-495c-966c-d2dec8875874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:08.279145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d51c9-1dbe-495c-966c-d2dec8875874 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:08.289088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 711/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:09.613174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88e8c-757b-451b-8208-63422dfe96a9 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:09.613758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88e8c-757b-451b-8208-63422dfe96a9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:09.613758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88e8c-757b-451b-8208-63422dfe96a9 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:09.615667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:09.621671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003241c-a11d-410f-bb19-793a0c5afa76 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:09.622227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003241c-a11d-410f-bb19-793a0c5afa76 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:09.622227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003241c-a11d-410f-bb19-793a0c5afa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:09.641885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d003241c-a11d-410f-bb19-793a0c5afa76 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:09.643112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d003241c-a11d-410f-bb19-793a0c5afa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:09.652814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:09.807099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88e8c-757b-451b-8208-63422dfe96a9 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:09.824679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88e8c-757b-451b-8208-63422dfe96a9 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:09.832221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba493f63-0304-422a-9944-8cf01e8ae937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:09.833143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493f63-0304-422a-9944-8cf01e8ae937 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:09.833426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493f63-0304-422a-9944-8cf01e8ae937 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:09.833705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493f63-0304-422a-9944-8cf01e8ae937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:09.844124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba493f63-0304-422a-9944-8cf01e8ae937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:09.846139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba493f63-0304-422a-9944-8cf01e8ae937 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:09.857004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 716/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:11.204129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212498d9-adf0-4293-a858-8ea6f23dab2f None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:11.204692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212498d9-adf0-4293-a858-8ea6f23dab2f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:11.204692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212498d9-adf0-4293-a858-8ea6f23dab2f None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:11.206425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:11.211554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88f14f-6f60-4b16-a1aa-2df500a63c86 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:11.212004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88f14f-6f60-4b16-a1aa-2df500a63c86 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:11.212109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88f14f-6f60-4b16-a1aa-2df500a63c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:11.231831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-cc88f14f-6f60-4b16-a1aa-2df500a63c86 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:11.233072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cc88f14f-6f60-4b16-a1aa-2df500a63c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:11.241608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:11.392775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212498d9-adf0-4293-a858-8ea6f23dab2f None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:11.409343 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212498d9-adf0-4293-a858-8ea6f23dab2f None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:11.415111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b007-8dee-4b2c-a817-bccfe5202571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:11.415728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b007-8dee-4b2c-a817-bccfe5202571 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:11.416004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b007-8dee-4b2c-a817-bccfe5202571 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:11.416278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b007-8dee-4b2c-a817-bccfe5202571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:11.425288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36b007-8dee-4b2c-a817-bccfe5202571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:11.426965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36b007-8dee-4b2c-a817-bccfe5202571 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:11.436844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 714/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:12.707635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44106-65f4-4889-be81-9e0b65159947 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:12.708191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44106-65f4-4889-be81-9e0b65159947 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:12.708191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44106-65f4-4889-be81-9e0b65159947 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:12.709906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:12.715528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7db67-b675-40c5-bb88-1280261aa71b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:12.715994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7db67-b675-40c5-bb88-1280261aa71b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:12.716086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7db67-b675-40c5-bb88-1280261aa71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:12.736224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-61e7db67-b675-40c5-bb88-1280261aa71b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:12.737490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-61e7db67-b675-40c5-bb88-1280261aa71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:12.747477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:12.896685 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44106-65f4-4889-be81-9e0b65159947 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:12.913187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44106-65f4-4889-be81-9e0b65159947 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:12.919718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3352b3-1ac6-4ca8-8d4a-ed625f0f47aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:12.920382 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3352b3-1ac6-4ca8-8d4a-ed625f0f47aa service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:12.920664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3352b3-1ac6-4ca8-8d4a-ed625f0f47aa service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:12.920942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3352b3-1ac6-4ca8-8d4a-ed625f0f47aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:12.930115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3352b3-1ac6-4ca8-8d4a-ed625f0f47aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:12.931729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3352b3-1ac6-4ca8-8d4a-ed625f0f47aa service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:12.942700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 719/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:14.198432 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24852930-43b0-4cc9-a5ef-1194302a109b None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:14.199103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24852930-43b0-4cc9-a5ef-1194302a109b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:14.199103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24852930-43b0-4cc9-a5ef-1194302a109b None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:14.200831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:14.206959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53910b-e03e-4684-b9ea-fe8dd9d2da68 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:14.207610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53910b-e03e-4684-b9ea-fe8dd9d2da68 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:14.207610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53910b-e03e-4684-b9ea-fe8dd9d2da68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:14.227942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fd53910b-e03e-4684-b9ea-fe8dd9d2da68 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:14.229236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fd53910b-e03e-4684-b9ea-fe8dd9d2da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:14.237825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:14.392392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24852930-43b0-4cc9-a5ef-1194302a109b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:14.407933 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24852930-43b0-4cc9-a5ef-1194302a109b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:14.413425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2663f4-d3a4-40a3-9fa5-91be5ffc2adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:14.414093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2663f4-d3a4-40a3-9fa5-91be5ffc2adb service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:14.414377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2663f4-d3a4-40a3-9fa5-91be5ffc2adb service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:14.414645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2663f4-d3a4-40a3-9fa5-91be5ffc2adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:14.423448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2663f4-d3a4-40a3-9fa5-91be5ffc2adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:14.425148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2663f4-d3a4-40a3-9fa5-91be5ffc2adb service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:14.435999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 717/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:15.707816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e138666-a66a-4ef8-93c7-5a49735402f7 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:15.708457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e138666-a66a-4ef8-93c7-5a49735402f7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:15.708457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e138666-a66a-4ef8-93c7-5a49735402f7 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:15.710258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:47:15.715837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cbb3f-1b49-44e0-bc7c-20cb2ad58f39 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:15.716358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cbb3f-1b49-44e0-bc7c-20cb2ad58f39 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:15.716566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cbb3f-1b49-44e0-bc7c-20cb2ad58f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:15.740227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-e94cbb3f-1b49-44e0-bc7c-20cb2ad58f39 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:15.741453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e94cbb3f-1b49-44e0-bc7c-20cb2ad58f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:15.750071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:15.903513 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e138666-a66a-4ef8-93c7-5a49735402f7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:15.919953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e138666-a66a-4ef8-93c7-5a49735402f7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:15.925833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9e993-729f-4841-b449-8dc2adc863b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:15.926513 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e993-729f-4841-b449-8dc2adc863b1 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:15.926789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e993-729f-4841-b449-8dc2adc863b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:15.927065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e993-729f-4841-b449-8dc2adc863b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:15.936051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9e993-729f-4841-b449-8dc2adc863b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:15.937638 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9e993-729f-4841-b449-8dc2adc863b1 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:15.947116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 722/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:17.270815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf02ae-9903-47ee-a19b-de78c7362e37 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:17.271367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf02ae-9903-47ee-a19b-de78c7362e37 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:17.271367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf02ae-9903-47ee-a19b-de78c7362e37 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:17.273055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:17.279199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ae620-551c-45a6-ac0b-733700cc5e84 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:17.279742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ae620-551c-45a6-ac0b-733700cc5e84 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:17.279742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ae620-551c-45a6-ac0b-733700cc5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:17.300018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-3b1ae620-551c-45a6-ac0b-733700cc5e84 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:17.301264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3b1ae620-551c-45a6-ac0b-733700cc5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:17.310223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:17.460971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf02ae-9903-47ee-a19b-de78c7362e37 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:17.477378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf02ae-9903-47ee-a19b-de78c7362e37 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:17.483115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2fb6f-4462-4dfa-a759-92e52dac41a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:17.483762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2fb6f-4462-4dfa-a759-92e52dac41a1 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:17.484046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2fb6f-4462-4dfa-a759-92e52dac41a1 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:17.484323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2fb6f-4462-4dfa-a759-92e52dac41a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:17.493071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2fb6f-4462-4dfa-a759-92e52dac41a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:17.494715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2fb6f-4462-4dfa-a759-92e52dac41a1 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:17.504817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 720/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:19.794306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4e2e7-2395-484a-bdb3-c4df747e9aa5 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:19.794931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4e2e7-2395-484a-bdb3-c4df747e9aa5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:19.794931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4e2e7-2395-484a-bdb3-c4df747e9aa5 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:19.796691 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:19.802851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb929b-c742-48d6-9915-ac5cb6d07680 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:19.803427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb929b-c742-48d6-9915-ac5cb6d07680 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:19.803427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb929b-c742-48d6-9915-ac5cb6d07680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:19.826488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-24fb929b-c742-48d6-9915-ac5cb6d07680 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:19.827701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-24fb929b-c742-48d6-9915-ac5cb6d07680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:19.837338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:19.877355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4e2e7-2395-484a-bdb3-c4df747e9aa5 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:19.889203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4e2e7-2395-484a-bdb3-c4df747e9aa5 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:19.892989 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce42671-0a78-42a2-b898-98352def19c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:19.893623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce42671-0a78-42a2-b898-98352def19c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:19.893913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce42671-0a78-42a2-b898-98352def19c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:19.894212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce42671-0a78-42a2-b898-98352def19c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:19.903774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce42671-0a78-42a2-b898-98352def19c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:19.905212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce42671-0a78-42a2-b898-98352def19c5 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:19.915406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 725/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:22.446628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6227c7-5256-4d7e-82ce-ae33dc6456a5 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:22.447270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6227c7-5256-4d7e-82ce-ae33dc6456a5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:22.447270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6227c7-5256-4d7e-82ce-ae33dc6456a5 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:22.449366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:22.455043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df296-c719-48dd-9ee6-265ef5ea76f6 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:22.455574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df296-c719-48dd-9ee6-265ef5ea76f6 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:22.455574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df296-c719-48dd-9ee6-265ef5ea76f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:22.475091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d35df296-c719-48dd-9ee6-265ef5ea76f6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:22.476321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d35df296-c719-48dd-9ee6-265ef5ea76f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:22.486029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:22.525209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6227c7-5256-4d7e-82ce-ae33dc6456a5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:22.537094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6227c7-5256-4d7e-82ce-ae33dc6456a5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:22.540823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac623d1d-e5a1-4504-a307-1d612de63688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:22.541744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac623d1d-e5a1-4504-a307-1d612de63688 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:22.542051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac623d1d-e5a1-4504-a307-1d612de63688 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:22.542400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac623d1d-e5a1-4504-a307-1d612de63688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:22.552505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac623d1d-e5a1-4504-a307-1d612de63688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:22.553960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac623d1d-e5a1-4504-a307-1d612de63688 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:22.563907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 723/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:25.192312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666309ed-3f1a-4194-9197-6c00a8dbc01e None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:25.193024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666309ed-3f1a-4194-9197-6c00a8dbc01e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:25.193024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666309ed-3f1a-4194-9197-6c00a8dbc01e None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:25.194626 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:25.200242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42fba-acaa-49d7-ba03-1a533baa0d01 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:25.200713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42fba-acaa-49d7-ba03-1a533baa0d01 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:25.200825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d42fba-acaa-49d7-ba03-1a533baa0d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:25.219940 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-e0d42fba-acaa-49d7-ba03-1a533baa0d01 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:25.221528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e0d42fba-acaa-49d7-ba03-1a533baa0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:25.231007 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:25.270630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666309ed-3f1a-4194-9197-6c00a8dbc01e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:25.283494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666309ed-3f1a-4194-9197-6c00a8dbc01e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:25.287620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0ecb9-a12d-40f3-a075-2c8801015aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:25.288288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0ecb9-a12d-40f3-a075-2c8801015aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:25.288572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0ecb9-a12d-40f3-a075-2c8801015aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:25.288844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0ecb9-a12d-40f3-a075-2c8801015aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:25.300388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0ecb9-a12d-40f3-a075-2c8801015aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:25.301875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0ecb9-a12d-40f3-a075-2c8801015aa1 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:25.313121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 728/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:27.789209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28f99c-9716-4b50-93ef-7ab22f9e8f07 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:27.789823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28f99c-9716-4b50-93ef-7ab22f9e8f07 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:27.789823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28f99c-9716-4b50-93ef-7ab22f9e8f07 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:27.791946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:27.797663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6276cd7-d4d4-4f22-a818-0567a7948376 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:27.798335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6276cd7-d4d4-4f22-a818-0567a7948376 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:27.798335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6276cd7-d4d4-4f22-a818-0567a7948376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:27.818330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e6276cd7-d4d4-4f22-a818-0567a7948376 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:27.819786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e6276cd7-d4d4-4f22-a818-0567a7948376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:27.829221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:27.867921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28f99c-9716-4b50-93ef-7ab22f9e8f07 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:27.879878 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28f99c-9716-4b50-93ef-7ab22f9e8f07 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:27.883658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770795-f3b0-4d52-b8f5-878e7841bcdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:27.884338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770795-f3b0-4d52-b8f5-878e7841bcdf service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:27.884615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770795-f3b0-4d52-b8f5-878e7841bcdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:27.884884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770795-f3b0-4d52-b8f5-878e7841bcdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:27.894697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64770795-f3b0-4d52-b8f5-878e7841bcdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:27.896128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64770795-f3b0-4d52-b8f5-878e7841bcdf service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:27.906323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 726/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:30.311707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8923ff-999e-4c02-b404-298328e747dc None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:30.312270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8923ff-999e-4c02-b404-298328e747dc None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:30.312270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8923ff-999e-4c02-b404-298328e747dc None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:30.314152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:30.319466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a6029-d665-487a-a464-8cd6b3fc0070 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:30.319948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a6029-d665-487a-a464-8cd6b3fc0070 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:30.320041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a6029-d665-487a-a464-8cd6b3fc0070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:30.338395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-481a6029-d665-487a-a464-8cd6b3fc0070 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:30.339852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-481a6029-d665-487a-a464-8cd6b3fc0070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:30.348585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:30.387806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8923ff-999e-4c02-b404-298328e747dc None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:30.399683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8923ff-999e-4c02-b404-298328e747dc None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:30.404090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e156c-9776-4899-a76c-9d36c78234dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:30.404789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e156c-9776-4899-a76c-9d36c78234dd service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:30.405073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e156c-9776-4899-a76c-9d36c78234dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:30.405343 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e156c-9776-4899-a76c-9d36c78234dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:30.415711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e156c-9776-4899-a76c-9d36c78234dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:30.417422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e156c-9776-4899-a76c-9d36c78234dd service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:30.427376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 731/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:32.782777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8105c-d188-4fa8-adc9-ee10e11f6902 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:32.783328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8105c-d188-4fa8-adc9-ee10e11f6902 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:32.783328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8105c-d188-4fa8-adc9-ee10e11f6902 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:32.785044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:32.790707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6d921-fbbe-428c-ac76-480e297ea239 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:32.791208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6d921-fbbe-428c-ac76-480e297ea239 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:32.791310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6d921-fbbe-428c-ac76-480e297ea239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:32.810200 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-eaf6d921-fbbe-428c-ac76-480e297ea239 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:32.811401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-eaf6d921-fbbe-428c-ac76-480e297ea239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:32.820149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:32.860318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8105c-d188-4fa8-adc9-ee10e11f6902 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:32.873306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8105c-d188-4fa8-adc9-ee10e11f6902 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:32.876616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f34c8f-3ab9-486d-b139-41c0b7381e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:32.877261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34c8f-3ab9-486d-b139-41c0b7381e39 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:32.877538 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34c8f-3ab9-486d-b139-41c0b7381e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:32.877813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34c8f-3ab9-486d-b139-41c0b7381e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:32.887780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f34c8f-3ab9-486d-b139-41c0b7381e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:32.889219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f34c8f-3ab9-486d-b139-41c0b7381e39 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:32.899052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 729/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:35.343964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f238f3-7f1c-4d0c-b0e4-99b7e77b14d5 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:35.344595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f238f3-7f1c-4d0c-b0e4-99b7e77b14d5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:35.344595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f238f3-7f1c-4d0c-b0e4-99b7e77b14d5 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:35.346725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:35.352359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679bbc5-82c8-489e-8ef4-0339b97c4241 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:35.352891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679bbc5-82c8-489e-8ef4-0339b97c4241 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:35.352891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679bbc5-82c8-489e-8ef4-0339b97c4241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:35.372830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-5679bbc5-82c8-489e-8ef4-0339b97c4241 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:35.374593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5679bbc5-82c8-489e-8ef4-0339b97c4241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:35.384575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:35.427647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f238f3-7f1c-4d0c-b0e4-99b7e77b14d5 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:35.440698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f238f3-7f1c-4d0c-b0e4-99b7e77b14d5 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:35.445143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd255f-bef4-4c81-a471-d40004f51b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:35.445803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd255f-bef4-4c81-a471-d40004f51b18 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:35.446126 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd255f-bef4-4c81-a471-d40004f51b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:35.446406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd255f-bef4-4c81-a471-d40004f51b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:35.458031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd255f-bef4-4c81-a471-d40004f51b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:35.459478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd255f-bef4-4c81-a471-d40004f51b18 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:35.469573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 734/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:37.911037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df341-9690-4697-8b09-22053addbd61 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:37.911637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df341-9690-4697-8b09-22053addbd61 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:37.911637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df341-9690-4697-8b09-22053addbd61 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:37.913335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:37.919613 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbade24f-b094-4614-b464-5cab802e052b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:37.920075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbade24f-b094-4614-b464-5cab802e052b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:37.920075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbade24f-b094-4614-b464-5cab802e052b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:37.939976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-dbade24f-b094-4614-b464-5cab802e052b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:37.941205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-dbade24f-b094-4614-b464-5cab802e052b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:37.950622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:37.988284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533df341-9690-4697-8b09-22053addbd61 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:38.000065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533df341-9690-4697-8b09-22053addbd61 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:38.003775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63e947-ac5d-4a3c-9332-74492aa7ba4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:38.004417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63e947-ac5d-4a3c-9332-74492aa7ba4a service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:38.004695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63e947-ac5d-4a3c-9332-74492aa7ba4a service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:38.004958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63e947-ac5d-4a3c-9332-74492aa7ba4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:38.015137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63e947-ac5d-4a3c-9332-74492aa7ba4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:38.016627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63e947-ac5d-4a3c-9332-74492aa7ba4a service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:38.026866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 732/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:40.387368 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2373b-1f7e-4c02-a4fa-8ff55a8f0e1b None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:40.388004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2373b-1f7e-4c02-a4fa-8ff55a8f0e1b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:40.388004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2373b-1f7e-4c02-a4fa-8ff55a8f0e1b None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:40.389829 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:40.397088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59cbd9-ba8e-4da2-a6b7-1cd294316d22 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:40.397626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59cbd9-ba8e-4da2-a6b7-1cd294316d22 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:40.397626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59cbd9-ba8e-4da2-a6b7-1cd294316d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:40.415808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8e59cbd9-ba8e-4da2-a6b7-1cd294316d22 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:40.417091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8e59cbd9-ba8e-4da2-a6b7-1cd294316d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:40.425235 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:40.462721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2373b-1f7e-4c02-a4fa-8ff55a8f0e1b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:40.475373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2373b-1f7e-4c02-a4fa-8ff55a8f0e1b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:40.479648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f61276-561b-4a8c-afd0-67058a443a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:40.480568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f61276-561b-4a8c-afd0-67058a443a30 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:40.480848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f61276-561b-4a8c-afd0-67058a443a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:40.481118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f61276-561b-4a8c-afd0-67058a443a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:40.490639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f61276-561b-4a8c-afd0-67058a443a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:40.492084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f61276-561b-4a8c-afd0-67058a443a30 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:40.506497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 737/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:47:42.867169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ea185-d252-406b-9871-4f13b3dfb192 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:42.867756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ea185-d252-406b-9871-4f13b3dfb192 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:42.867756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ea185-d252-406b-9871-4f13b3dfb192 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:42.869604 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 734/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:47:42.876386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2027865-abf4-4bc2-a7d1-7e4a8a802f0a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:42.877178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2027865-abf4-4bc2-a7d1-7e4a8a802f0a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:42.877178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2027865-abf4-4bc2-a7d1-7e4a8a802f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:42.898980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d2027865-abf4-4bc2-a7d1-7e4a8a802f0a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:47:42.900232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d2027865-abf4-4bc2-a7d1-7e4a8a802f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:47:42.910015 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 738/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:47:42.948117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ea185-d252-406b-9871-4f13b3dfb192 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:47:42.960979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ea185-d252-406b-9871-4f13b3dfb192 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:47:42.965548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949266-ed7e-41ad-a428-5b9538e09096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:47:42.966246 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949266-ed7e-41ad-a428-5b9538e09096 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:47:42.966552 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949266-ed7e-41ad-a428-5b9538e09096 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:47:42.966829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949266-ed7e-41ad-a428-5b9538e09096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:47:42.977730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949266-ed7e-41ad-a428-5b9538e09096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:47:42.979656 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949266-ed7e-41ad-a428-5b9538e09096 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:47:42.990382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 735/1473] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:48:03.737327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84495ed-5d52-4390-b43b-29352ef3fd9d None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:03.738047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84495ed-5d52-4390-b43b-29352ef3fd9d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:03.738047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84495ed-5d52-4390-b43b-29352ef3fd9d None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:03.739831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 739/1474] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:48:03.745638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe1e44-ac81-4518-a8c1-90e1b0d922d5 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:03.746158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe1e44-ac81-4518-a8c1-90e1b0d922d5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:03.746260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe1e44-ac81-4518-a8c1-90e1b0d922d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:03.765576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-a4fe1e44-ac81-4518-a8c1-90e1b0d922d5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:48:03.766813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a4fe1e44-ac81-4518-a8c1-90e1b0d922d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:48:03.776340 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 736/1475] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:48:03.823350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f44d-fa36-43c1-b3a4-0d16e1586a4f None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:03.823350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f44d-fa36-43c1-b3a4-0d16e1586a4f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:03.823616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f44d-fa36-43c1-b3a4-0d16e1586a4f None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:03.825379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 740/1476] 10.222.0.49 () {54 vars in 961 bytes} [Tue Mar 22 19:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:48:03.830478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0426-4afd-43bf-92f1-5af584f323ba None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:03.830745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0426-4afd-43bf-92f1-5af584f323ba None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:03.831039 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0426-4afd-43bf-92f1-5af584f323ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:03.851725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-302e0426-4afd-43bf-92f1-5af584f323ba None None] MFA Rules not processed for user `02aff559435a445db07636197a534f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:48:03.852975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-302e0426-4afd-43bf-92f1-5af584f323ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:48:03.860911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 737/1477] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Mar 22 19:48:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:48:03.868645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f44d-fa36-43c1-b3a4-0d16e1586a4f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:48:03.880036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f44d-fa36-43c1-b3a4-0d16e1586a4f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:48:03.883896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b19b7-b8f7-4f6f-8c03-70c9e23c94da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:48:03.884504 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b19b7-b8f7-4f6f-8c03-70c9e23c94da service glance] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:03.884781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b19b7-b8f7-4f6f-8c03-70c9e23c94da service glance] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:03.885022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b19b7-b8f7-4f6f-8c03-70c9e23c94da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:03.894929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b19b7-b8f7-4f6f-8c03-70c9e23c94da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:48:03.896388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b19b7-b8f7-4f6f-8c03-70c9e23c94da service glance] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:48:03.907298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 741/1478] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:48:06.365236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51f408-25ff-4d88-8c86-7295a5d57673 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:06.365873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51f408-25ff-4d88-8c86-7295a5d57673 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:06.365873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51f408-25ff-4d88-8c86-7295a5d57673 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:06.367602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 738/1479] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:48:06.373422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f41b3-7858-45de-a005-f928af1d7094 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:06.374079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f41b3-7858-45de-a005-f928af1d7094 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:06.374079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f41b3-7858-45de-a005-f928af1d7094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:06.394728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-151f41b3-7858-45de-a005-f928af1d7094 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:48:06.395971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-151f41b3-7858-45de-a005-f928af1d7094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:48:06.404797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 742/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:48:06.434099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51f408-25ff-4d88-8c86-7295a5d57673 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:48:06.450682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51f408-25ff-4d88-8c86-7295a5d57673 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:48:06.455959 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ba347-1bf9-48fa-bb59-12454442b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:48:06.456598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ba347-1bf9-48fa-bb59-12454442b7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:06.456911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ba347-1bf9-48fa-bb59-12454442b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:06.457186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ba347-1bf9-48fa-bb59-12454442b7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:06.457929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ba347-1bf9-48fa-bb59-12454442b7d3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:48:06.459882 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ba347-1bf9-48fa-bb59-12454442b7d3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:48:06.477130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 739/1481] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Mar 22 19:48:06 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:48:08.882699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05864a6-875a-4bea-ac2c-e9813f9c27ff None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:08.883310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05864a6-875a-4bea-ac2c-e9813f9c27ff None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:08.883310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05864a6-875a-4bea-ac2c-e9813f9c27ff None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:08.885092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 743/1482] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:48:08.890722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9bc6c-34ab-44cc-bb34-99bf8b2d3bac None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:08.891211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9bc6c-34ab-44cc-bb34-99bf8b2d3bac None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:08.891311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9bc6c-34ab-44cc-bb34-99bf8b2d3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:08.912996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4bb9bc6c-34ab-44cc-bb34-99bf8b2d3bac None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:48:08.914242 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4bb9bc6c-34ab-44cc-bb34-99bf8b2d3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:48:08.923265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 740/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:48:08.965525 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05864a6-875a-4bea-ac2c-e9813f9c27ff None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:48:08.981297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05864a6-875a-4bea-ac2c-e9813f9c27ff None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:48:08.987229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c17d5-5888-4e6e-b5ef-f627fdd64ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:48:08.987879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c17d5-5888-4e6e-b5ef-f627fdd64ab3 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:08.988161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c17d5-5888-4e6e-b5ef-f627fdd64ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:08.988439 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c17d5-5888-4e6e-b5ef-f627fdd64ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:08.997623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c17d5-5888-4e6e-b5ef-f627fdd64ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:48:08.999374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c17d5-5888-4e6e-b5ef-f627fdd64ab3 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:48:09.010904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 744/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:48:11.540318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4a1f-df04-4851-a299-898c8dceeb6b None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:11.540893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4a1f-df04-4851-a299-898c8dceeb6b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:11.540893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4a1f-df04-4851-a299-898c8dceeb6b None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:11.543035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 741/1485] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:48:11.550261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568ba5e-e87b-47d1-87a3-ec691742a371 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:11.550764 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568ba5e-e87b-47d1-87a3-ec691742a371 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:11.551517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568ba5e-e87b-47d1-87a3-ec691742a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:11.578442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-f568ba5e-e87b-47d1-87a3-ec691742a371 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:48:11.579634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f568ba5e-e87b-47d1-87a3-ec691742a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:48:11.587505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 745/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:48:11.624270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a4a1f-df04-4851-a299-898c8dceeb6b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:48:11.636367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a4a1f-df04-4851-a299-898c8dceeb6b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:48:11.640495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e2024-ff17-453c-ac03-cc7ef4271571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:48:11.641053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e2024-ff17-453c-ac03-cc7ef4271571 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:11.641335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e2024-ff17-453c-ac03-cc7ef4271571 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:11.641610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e2024-ff17-453c-ac03-cc7ef4271571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:11.650912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e2024-ff17-453c-ac03-cc7ef4271571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:48:11.652348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e2024-ff17-453c-ac03-cc7ef4271571 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:48:11.661974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 742/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:48:14.044717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e96fb-8eb6-4b1d-89df-f3406e3998d3 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:14.045622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e96fb-8eb6-4b1d-89df-f3406e3998d3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:14.045622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e96fb-8eb6-4b1d-89df-f3406e3998d3 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:14.047669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 746/1488] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:48:14.053855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f54d92-1f06-4c8f-9542-6a8f82310886 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:14.054430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f54d92-1f06-4c8f-9542-6a8f82310886 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:14.054430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f54d92-1f06-4c8f-9542-6a8f82310886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:14.077379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-11f54d92-1f06-4c8f-9542-6a8f82310886 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:48:14.079261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-11f54d92-1f06-4c8f-9542-6a8f82310886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:48:14.087842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 743/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:48:14.142074 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e96fb-8eb6-4b1d-89df-f3406e3998d3 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:48:14.154362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e96fb-8eb6-4b1d-89df-f3406e3998d3 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:48:14.158476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1e11f-4f46-4be2-9c44-b1d8576e0ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:48:14.159127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e11f-4f46-4be2-9c44-b1d8576e0ebd service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:14.159400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e11f-4f46-4be2-9c44-b1d8576e0ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:14.159668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e11f-4f46-4be2-9c44-b1d8576e0ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:14.169775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1e11f-4f46-4be2-9c44-b1d8576e0ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:48:14.171297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1e11f-4f46-4be2-9c44-b1d8576e0ebd service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:48:14.183920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 747/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:48:16.867328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddffc4-61fb-40b5-867e-4962894a1d31 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:16.867920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddffc4-61fb-40b5-867e-4962894a1d31 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:16.867920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddffc4-61fb-40b5-867e-4962894a1d31 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:16.870102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 744/1491] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:48:16.875940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dfd3e-264e-4c35-8ae0-061b1666216c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:16.876487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dfd3e-264e-4c35-8ae0-061b1666216c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:16.876487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dfd3e-264e-4c35-8ae0-061b1666216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:16.901789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d88dfd3e-264e-4c35-8ae0-061b1666216c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:48:16.903159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d88dfd3e-264e-4c35-8ae0-061b1666216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:48:16.912781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 748/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:48:16.960047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddffc4-61fb-40b5-867e-4962894a1d31 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:48:16.972445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddffc4-61fb-40b5-867e-4962894a1d31 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:48:16.977298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f05b1-37db-430f-aa46-523fe018233f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:48:16.978064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f05b1-37db-430f-aa46-523fe018233f service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:16.978545 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f05b1-37db-430f-aa46-523fe018233f service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:16.978833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f05b1-37db-430f-aa46-523fe018233f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:16.990413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f05b1-37db-430f-aa46-523fe018233f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:48:16.991891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f05b1-37db-430f-aa46-523fe018233f service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:48:17.004187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 745/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:48:19.707810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d729f21-14ff-4dc2-a45e-ba58f73cf4ef None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:19.708432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d729f21-14ff-4dc2-a45e-ba58f73cf4ef None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:19.708432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d729f21-14ff-4dc2-a45e-ba58f73cf4ef None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:19.710210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 749/1494] 10.222.0.49 () {54 vars in 926 bytes} [Tue Mar 22 19:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:48:19.717460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6184dd-b157-434b-b423-93f4f095bd11 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:19.718071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6184dd-b157-434b-b423-93f4f095bd11 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:19.718071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6184dd-b157-434b-b423-93f4f095bd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:19.739495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1e6184dd-b157-434b-b423-93f4f095bd11 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:48:19.740793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1e6184dd-b157-434b-b423-93f4f095bd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:48:19.750295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 746/1495] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Mar 22 19:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:48:19.794490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d729f21-14ff-4dc2-a45e-ba58f73cf4ef None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:48:19.806358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d729f21-14ff-4dc2-a45e-ba58f73cf4ef None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:48:19.810421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb7240-75ae-48e5-a95b-85d808231292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:48:19.811066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb7240-75ae-48e5-a95b-85d808231292 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:48:19.811349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb7240-75ae-48e5-a95b-85d808231292 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:48:19.811628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb7240-75ae-48e5-a95b-85d808231292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:48:19.821332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb7240-75ae-48e5-a95b-85d808231292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:48:19.822863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb7240-75ae-48e5-a95b-85d808231292 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:48:19.832856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 750/1496] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:49:41.210456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b454b-7b3f-43d5-9ee7-f2eac48404a0 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.211124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b454b-7b3f-43d5-9ee7-f2eac48404a0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.211416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b454b-7b3f-43d5-9ee7-f2eac48404a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.234609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3f7b454b-7b3f-43d5-9ee7-f2eac48404a0 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:49:41.235828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3f7b454b-7b3f-43d5-9ee7-f2eac48404a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:49:41.245489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 747/1497] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:49:41.255319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450209cc-5729-4ed3-b0ad-96cd136c7486 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.255848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450209cc-5729-4ed3-b0ad-96cd136c7486 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.255848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450209cc-5729-4ed3-b0ad-96cd136c7486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.274928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-450209cc-5729-4ed3-b0ad-96cd136c7486 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:49:41.276133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-450209cc-5729-4ed3-b0ad-96cd136c7486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:49:41.285968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 751/1498] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:49:41.292204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b454b-7b3f-43d5-9ee7-f2eac48404a0 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:41.306631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b454b-7b3f-43d5-9ee7-f2eac48404a0 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:41.313004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:41.313666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.313968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.314259 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.314970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:49:41.315279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:41.316330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING py.warnings [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:49:41.316330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: warnings.warn(msg) Mar 22 19:49:41.316330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: Mar 22 19:49:41.317220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:41.329267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 748/1499] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:49:41.337796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450209cc-5729-4ed3-b0ad-96cd136c7486 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:41.347806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450209cc-5729-4ed3-b0ad-96cd136c7486 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:41.354335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7d307-997f-43ba-8112-2cf9c1418528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:41.355010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7d307-997f-43ba-8112-2cf9c1418528 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.355294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7d307-997f-43ba-8112-2cf9c1418528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.355565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7d307-997f-43ba-8112-2cf9c1418528 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.356289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7d307-997f-43ba-8112-2cf9c1418528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:41.358084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING py.warnings [None req-f2e7d307-997f-43ba-8112-2cf9c1418528 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:49:41.358084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: warnings.warn(msg) Mar 22 19:49:41.358084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: Mar 22 19:49:41.359291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7d307-997f-43ba-8112-2cf9c1418528 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:41.399212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 752/1500] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:49:41 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:49:41.404459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:41.420374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d366270-afde-426d-9be1-f1ed91a72e5d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:41.479851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15ca7-1cc7-4702-a2ba-82adba670046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:41.480428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15ca7-1cc7-4702-a2ba-82adba670046 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.480713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15ca7-1cc7-4702-a2ba-82adba670046 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.480984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15ca7-1cc7-4702-a2ba-82adba670046 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.481676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a15ca7-1cc7-4702-a2ba-82adba670046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:41.482746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING py.warnings [None req-71a15ca7-1cc7-4702-a2ba-82adba670046 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:49:41.482746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: warnings.warn(msg) Mar 22 19:49:41.482746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: Mar 22 19:49:41.483967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a15ca7-1cc7-4702-a2ba-82adba670046 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:41.510720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 749/1501] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:49:41 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:49:41.515192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7d307-997f-43ba-8112-2cf9c1418528 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:41.526162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7d307-997f-43ba-8112-2cf9c1418528 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:41.531885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c5a92-f555-4679-8554-afa569fb87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:41.532556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c5a92-f555-4679-8554-afa569fb87bd admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.532834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c5a92-f555-4679-8554-afa569fb87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.533103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c5a92-f555-4679-8554-afa569fb87bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.533827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c5a92-f555-4679-8554-afa569fb87bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:41.534887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING py.warnings [None req-578c5a92-f555-4679-8554-afa569fb87bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:49:41.534887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: warnings.warn(msg) Mar 22 19:49:41.534887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: Mar 22 19:49:41.535769 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c5a92-f555-4679-8554-afa569fb87bd admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:41.549605 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 753/1502] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:49:41.554013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15ca7-1cc7-4702-a2ba-82adba670046 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:41.567894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15ca7-1cc7-4702-a2ba-82adba670046 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:41.575541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c736fa5-243f-4172-b49a-6e314443e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:41.576231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c736fa5-243f-4172-b49a-6e314443e30b admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.576489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c736fa5-243f-4172-b49a-6e314443e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.576804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c736fa5-243f-4172-b49a-6e314443e30b admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.577677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c736fa5-243f-4172-b49a-6e314443e30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:41.578902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING py.warnings [None req-0c736fa5-243f-4172-b49a-6e314443e30b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:49:41.578902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: warnings.warn(msg) Mar 22 19:49:41.578902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: Mar 22 19:49:41.579891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c736fa5-243f-4172-b49a-6e314443e30b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:41.595581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 750/1503] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:49:41.600332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c5a92-f555-4679-8554-afa569fb87bd admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:41.611554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c5a92-f555-4679-8554-afa569fb87bd admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:41.617252 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000fc2a-f956-4ad3-80ed-941293cfd6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:41.618323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000fc2a-f956-4ad3-80ed-941293cfd6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.618595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000fc2a-f956-4ad3-80ed-941293cfd6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.618867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000fc2a-f956-4ad3-80ed-941293cfd6f7 admin admin] PATH_INFO: `/v3/projects/5f4a35375d1a44c185d0ae4f26f6f62d/users/6f9eff68464d4eaa8a2e4feca2c82d2b/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.636599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000fc2a-f956-4ad3-80ed-941293cfd6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4a35375d1a44c185d0ae4f26f6f62d, user_id=6f9eff68464d4eaa8a2e4feca2c82d2b, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:41.637668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING py.warnings [None req-8000fc2a-f956-4ad3-80ed-941293cfd6f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:49:41.637668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: warnings.warn(msg) Mar 22 19:49:41.637668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: Mar 22 19:49:41.639652 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000fc2a-f956-4ad3-80ed-941293cfd6f7 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:41.656132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 754/1504] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:49:41 2022] PUT /identity/v3/projects/5f4a35375d1a44c185d0ae4f26f6f62d/users/6f9eff68464d4eaa8a2e4feca2c82d2b/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:49:41.668087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e59e5b-71e6-418d-bdaf-8cb614e9ec8f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.668368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e59e5b-71e6-418d-bdaf-8cb614e9ec8f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.668644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e59e5b-71e6-418d-bdaf-8cb614e9ec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.696889 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-62e59e5b-71e6-418d-bdaf-8cb614e9ec8f None None] MFA Rules not processed for user `6f9eff68464d4eaa8a2e4feca2c82d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:49:41.698135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-62e59e5b-71e6-418d-bdaf-8cb614e9ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:49:41.772128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 751/1505] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:49:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:49:41.788578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000fc2a-f956-4ad3-80ed-941293cfd6f7 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:41.865904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000fc2a-f956-4ad3-80ed-941293cfd6f7 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:41.872134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5eb9-9927-4457-a764-c37d29a05115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:41.872794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5eb9-9927-4457-a764-c37d29a05115 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.873076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5eb9-9927-4457-a764-c37d29a05115 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.873349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5eb9-9927-4457-a764-c37d29a05115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.881796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a5eb9-9927-4457-a764-c37d29a05115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:41.883492 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a5eb9-9927-4457-a764-c37d29a05115 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:41.892606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 755/1506] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:49:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:49:41.967467 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f23da-e2dc-453a-ba91-63081ad5eefc None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:41.967756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f23da-e2dc-453a-ba91-63081ad5eefc None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:41.968031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f23da-e2dc-453a-ba91-63081ad5eefc None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:41.969884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 752/1507] 10.222.0.49 () {52 vars in 829 bytes} [Tue Mar 22 19:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:49:41.974412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5eb9-9927-4457-a764-c37d29a05115 service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:42.039440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5eb9-9927-4457-a764-c37d29a05115 service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:42.044498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:42.045461 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:42.045635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:42.045960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] PATH_INFO: `/v3/users/6f9eff68464d4eaa8a2e4feca2c82d2b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:42.047207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9eff68464d4eaa8a2e4feca2c82d2b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:42.048254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING py.warnings [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:49:42.048254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: warnings.warn(msg) Mar 22 19:49:42.048254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: Mar 22 19:49:42.049460 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:42.121377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9eff68464d4eaa8a2e4feca2c82d2b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.150372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9eff68464d4eaa8a2e4feca2c82d2b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.161921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9eff68464d4eaa8a2e4feca2c82d2b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.162788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9eff68464d4eaa8a2e4feca2c82d2b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.175954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9eff68464d4eaa8a2e4feca2c82d2b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.182426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 756/1508] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:49:41 2022] DELETE /identity/v3/users/6f9eff68464d4eaa8a2e4feca2c82d2b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:49:42.187273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a9d7-47a2-40a6-94bf-b928bc20247e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:42.187553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a9d7-47a2-40a6-94bf-b928bc20247e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:42.187834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a9d7-47a2-40a6-94bf-b928bc20247e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:42.210991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b7a8a9d7-47a2-40a6-94bf-b928bc20247e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:49:42.212423 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b7a8a9d7-47a2-40a6-94bf-b928bc20247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:49:42.297087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 753/1509] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:49:42.309206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:42.310892 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:49:42.372768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d6e30-0b0a-44d9-b947-6641aa3b254c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:42.377165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569adb5-7277-4cc5-91e8-bd8cd993c1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:42.377835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569adb5-7277-4cc5-91e8-bd8cd993c1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:42.378140 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569adb5-7277-4cc5-91e8-bd8cd993c1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:42.378416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569adb5-7277-4cc5-91e8-bd8cd993c1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:42.388499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569adb5-7277-4cc5-91e8-bd8cd993c1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:42.389988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569adb5-7277-4cc5-91e8-bd8cd993c1e6 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:42.399778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 757/1510] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:49:42.778244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a9d7-47a2-40a6-94bf-b928bc20247e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:49:42.779846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b7a8a9d7-47a2-40a6-94bf-b928bc20247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:49:42.792547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a9d7-47a2-40a6-94bf-b928bc20247e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:49:42.798651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:49:42.799521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:49:42.799831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:49:42.800107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] PATH_INFO: `/v3/projects/5f4a35375d1a44c185d0ae4f26f6f62d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:49:42.801404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4a35375d1a44c185d0ae4f26f6f62d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:49:42.803290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING py.warnings [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:49:42.803290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: warnings.warn(msg) Mar 22 19:49:42.803290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: Mar 22 19:49:42.804696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:49:42.870449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4a35375d1a44c185d0ae4f26f6f62d', 'request_id': 'req-62e2ada1-676b-40bd-8991-e6f6721e1928'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.877426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4a35375d1a44c185d0ae4f26f6f62d', 'request_id': 'req-62e2ada1-676b-40bd-8991-e6f6721e1928'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.894046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4a35375d1a44c185d0ae4f26f6f62d', 'request_id': 'req-62e2ada1-676b-40bd-8991-e6f6721e1928'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.914529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] The token cache is being invalidate because project 5f4a35375d1a44c185d0ae4f26f6f62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:49:42.914872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.915636 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-62e2ada1-676b-40bd-8991-e6f6721e1928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:49:42.917448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 754/1511] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:49:42 2022] DELETE /identity/v3/projects/5f4a35375d1a44c185d0ae4f26f6f62d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:51:25.634684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ddce2-73e5-4e00-8239-d3c8cfc017f3 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:25.635661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ddce2-73e5-4e00-8239-d3c8cfc017f3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:25.635661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ddce2-73e5-4e00-8239-d3c8cfc017f3 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:25.638505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 758/1512] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:51:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:51:25.644025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd58e-0438-4662-ae5c-876c06251db7 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:25.644567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd58e-0438-4662-ae5c-876c06251db7 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:25.644567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd58e-0438-4662-ae5c-876c06251db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:25.665392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-bb0bd58e-0438-4662-ae5c-876c06251db7 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:25.666750 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-bb0bd58e-0438-4662-ae5c-876c06251db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:25.731001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 755/1513] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:51:25.888014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ddce2-73e5-4e00-8239-d3c8cfc017f3 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:51:25.890422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-385ddce2-73e5-4e00-8239-d3c8cfc017f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:25.982150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ddce2-73e5-4e00-8239-d3c8cfc017f3 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:51:25.991342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac0d3a-ed40-477a-b6b8-4e2df3b97ee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:51:25.992368 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0d3a-ed40-477a-b6b8-4e2df3b97ee8 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:25.992770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0d3a-ed40-477a-b6b8-4e2df3b97ee8 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:25.993155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac0d3a-ed40-477a-b6b8-4e2df3b97ee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:26.005778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac0d3a-ed40-477a-b6b8-4e2df3b97ee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:51:26.007432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac0d3a-ed40-477a-b6b8-4e2df3b97ee8 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:51:26.020614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 759/1514] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:51:27.295197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bfbcb-f933-4cb1-abb3-b79759cea94b None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:27.295805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bfbcb-f933-4cb1-abb3-b79759cea94b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:27.295805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bfbcb-f933-4cb1-abb3-b79759cea94b None None] PATH_INFO: `/v3` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:27.297103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 756/1515] 10.222.0.46 () {54 vars in 925 bytes} [Tue Mar 22 19:51:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:51:27.306265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda2c3-8b44-49b9-af6b-f1d5380b47f6 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:27.307062 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda2c3-8b44-49b9-af6b-f1d5380b47f6 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:27.307062 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda2c3-8b44-49b9-af6b-f1d5380b47f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:27.326726 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-30bda2c3-8b44-49b9-af6b-f1d5380b47f6 None None] MFA Rules not processed for user `eed3ec40f28c4bc990d8f56466889aff`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:27.327937 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-30bda2c3-8b44-49b9-af6b-f1d5380b47f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:27.345232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880948f-4f8d-42b6-8b16-d18b67c5e1bb None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:27.345486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880948f-4f8d-42b6-8b16-d18b67c5e1bb None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:27.345765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880948f-4f8d-42b6-8b16-d18b67c5e1bb None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:27.347649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 757/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:51:27.352692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ab0f4-21ec-443a-9d96-ed2df57d1a26 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:27.352981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ab0f4-21ec-443a-9d96-ed2df57d1a26 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:27.353268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ab0f4-21ec-443a-9d96-ed2df57d1a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:27.371731 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-416ab0f4-21ec-443a-9d96-ed2df57d1a26 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:27.372958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-416ab0f4-21ec-443a-9d96-ed2df57d1a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:27.381085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 758/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:51:27.395151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 760/1518] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Mar 22 19:51:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:51:27.538495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ab0f4-21ec-443a-9d96-ed2df57d1a26 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:51:27.552416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ab0f4-21ec-443a-9d96-ed2df57d1a26 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:51:27.558557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f80bbf-a0e5-4bbe-b296-f12784323389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:51:27.559212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80bbf-a0e5-4bbe-b296-f12784323389 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:27.559491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80bbf-a0e5-4bbe-b296-f12784323389 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:27.559765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f80bbf-a0e5-4bbe-b296-f12784323389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:27.568872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f80bbf-a0e5-4bbe-b296-f12784323389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:51:27.570570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f80bbf-a0e5-4bbe-b296-f12784323389 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:51:27.580570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 759/1519] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:51:31.691825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385c10-07df-4912-aa59-a879c8239d49 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:31.692570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385c10-07df-4912-aa59-a879c8239d49 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:31.692570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385c10-07df-4912-aa59-a879c8239d49 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:31.694399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 761/1520] 10.222.0.49 () {54 vars in 960 bytes} [Tue Mar 22 19:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:51:31.700556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499be35b-16b4-4c85-8f20-66e0763f37f7 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:31.701129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499be35b-16b4-4c85-8f20-66e0763f37f7 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:31.701129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499be35b-16b4-4c85-8f20-66e0763f37f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:31.724671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-499be35b-16b4-4c85-8f20-66e0763f37f7 None None] MFA Rules not processed for user `eed3ec40f28c4bc990d8f56466889aff`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:31.725918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-499be35b-16b4-4c85-8f20-66e0763f37f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:31.739247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 760/1521] 10.222.0.49 () {58 vars in 1057 bytes} [Tue Mar 22 19:51:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:51:31.747395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385c10-07df-4912-aa59-a879c8239d49 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:51:31.761548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385c10-07df-4912-aa59-a879c8239d49 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:51:31.767425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff69715-66cf-4d9f-b47a-f929a3fdba7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:51:31.768070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff69715-66cf-4d9f-b47a-f929a3fdba7a service placement] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:31.768350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff69715-66cf-4d9f-b47a-f929a3fdba7a service placement] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:31.768629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff69715-66cf-4d9f-b47a-f929a3fdba7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:31.777707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff69715-66cf-4d9f-b47a-f929a3fdba7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:51:31.779589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff69715-66cf-4d9f-b47a-f929a3fdba7a service placement] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:51:31.794572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 762/1522] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:51:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:51:39.320130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a097f-7111-451d-b2b4-22ce9a62437b None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:39.320737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a097f-7111-451d-b2b4-22ce9a62437b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:39.320737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a097f-7111-451d-b2b4-22ce9a62437b None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:39.322556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 761/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:51:39.328817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fe01f-ee13-47cd-9cea-0bc3592cdd51 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:39.329534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fe01f-ee13-47cd-9cea-0bc3592cdd51 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:39.329655 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fe01f-ee13-47cd-9cea-0bc3592cdd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:39.350023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-369fe01f-ee13-47cd-9cea-0bc3592cdd51 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:39.351271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-369fe01f-ee13-47cd-9cea-0bc3592cdd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:39.360581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 763/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:51:39.523038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a097f-7111-451d-b2b4-22ce9a62437b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:51:39.541843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a097f-7111-451d-b2b4-22ce9a62437b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:51:39.548513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f02758-3b93-4a70-8bd7-d73d11cc34bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:51:39.549331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02758-3b93-4a70-8bd7-d73d11cc34bd service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:39.549531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02758-3b93-4a70-8bd7-d73d11cc34bd service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:39.549744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02758-3b93-4a70-8bd7-d73d11cc34bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:39.558900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f02758-3b93-4a70-8bd7-d73d11cc34bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:51:39.560556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f02758-3b93-4a70-8bd7-d73d11cc34bd service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:51:39.570808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 762/1525] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:51:40.855641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4ce00-3397-47a6-b508-bb31aff6ead6 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:40.856129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4ce00-3397-47a6-b508-bb31aff6ead6 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:40.856227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4ce00-3397-47a6-b508-bb31aff6ead6 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:40.858011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 764/1526] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 22 19:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:51:40.864887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2a30-4176-4a1c-a18f-1473d801513e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:40.865375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2a30-4176-4a1c-a18f-1473d801513e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:40.865477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2a30-4176-4a1c-a18f-1473d801513e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:40.884603 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-04ba2a30-4176-4a1c-a18f-1473d801513e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:40.885821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-04ba2a30-4176-4a1c-a18f-1473d801513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:40.898329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 763/1527] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 22 19:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:51:41.059733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4ce00-3397-47a6-b508-bb31aff6ead6 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:51:41.079363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4ce00-3397-47a6-b508-bb31aff6ead6 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:51:41.086792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722bf11-0478-44fc-a403-6de624de3ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:51:41.087469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722bf11-0478-44fc-a403-6de624de3ed4 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:41.087753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722bf11-0478-44fc-a403-6de624de3ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:41.088068 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722bf11-0478-44fc-a403-6de624de3ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:41.098138 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722bf11-0478-44fc-a403-6de624de3ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:51:41.099748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722bf11-0478-44fc-a403-6de624de3ed4 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:51:41.109881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 765/1528] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:51:45.459029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c0aa-4206-4875-9529-9569821d4036 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:45.459611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c0aa-4206-4875-9529-9569821d4036 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:45.459999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c0aa-4206-4875-9529-9569821d4036 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:45.461960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 764/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:51:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:51:45.468988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff2bce-ba97-466c-8d09-3570c05193e9 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:45.470101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff2bce-ba97-466c-8d09-3570c05193e9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:45.470101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff2bce-ba97-466c-8d09-3570c05193e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:45.488610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-9bff2bce-ba97-466c-8d09-3570c05193e9 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:45.489803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9bff2bce-ba97-466c-8d09-3570c05193e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:45.499369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 766/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:51:45.537974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9c0aa-4206-4875-9529-9569821d4036 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:51:45.540198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9ed9c0aa-4206-4875-9529-9569821d4036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:45.606044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9c0aa-4206-4875-9529-9569821d4036 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:51:45.610349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4036-8339-45b3-9957-6fa981fe3f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:51:45.610995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4036-8339-45b3-9957-6fa981fe3f07 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:45.611279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4036-8339-45b3-9957-6fa981fe3f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:45.611555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4036-8339-45b3-9957-6fa981fe3f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:45.621518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4036-8339-45b3-9957-6fa981fe3f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:51:45.622983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4036-8339-45b3-9957-6fa981fe3f07 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:51:45.632658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 765/1531] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:51:47.947303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3a37-15b0-47ca-8d0c-c0128e048742 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:47.948088 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3a37-15b0-47ca-8d0c-c0128e048742 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:47.948088 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3a37-15b0-47ca-8d0c-c0128e048742 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:47.950667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 767/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:51:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:51:47.959373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc833c14-1566-4c34-b773-a67ca7235082 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:47.959811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc833c14-1566-4c34-b773-a67ca7235082 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:47.959951 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc833c14-1566-4c34-b773-a67ca7235082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:47.982265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-bc833c14-1566-4c34-b773-a67ca7235082 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:47.983466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-bc833c14-1566-4c34-b773-a67ca7235082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:47.992142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 766/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:51:48.033400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3a37-15b0-47ca-8d0c-c0128e048742 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:51:48.035410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-49bf3a37-15b0-47ca-8d0c-c0128e048742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:48.049321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3a37-15b0-47ca-8d0c-c0128e048742 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:51:48.053632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30e91c-cf8d-425d-9452-f3f3ea5d6d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:51:48.054308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e91c-cf8d-425d-9452-f3f3ea5d6d8c service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:48.054591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e91c-cf8d-425d-9452-f3f3ea5d6d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:48.054863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e91c-cf8d-425d-9452-f3f3ea5d6d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:48.064853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e91c-cf8d-425d-9452-f3f3ea5d6d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:51:48.066383 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e91c-cf8d-425d-9452-f3f3ea5d6d8c service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:51:48.076181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 768/1534] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:51:52.137164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cd442-0c22-4a3b-b936-890748bfbd77 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:52.137776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cd442-0c22-4a3b-b936-890748bfbd77 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:52.137776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cd442-0c22-4a3b-b936-890748bfbd77 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:52.139717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 767/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:51:52.145270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5ca9d-961b-461b-b2c1-283c18fc29cf None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:52.145722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5ca9d-961b-461b-b2c1-283c18fc29cf None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:52.145859 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5ca9d-961b-461b-b2c1-283c18fc29cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:52.170649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-b8e5ca9d-961b-461b-b2c1-283c18fc29cf None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:52.172511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b8e5ca9d-961b-461b-b2c1-283c18fc29cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:52.182931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 769/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:51:52.457447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cd442-0c22-4a3b-b936-890748bfbd77 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:51:52.460276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-cd5cd442-0c22-4a3b-b936-890748bfbd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:52.527443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cd442-0c22-4a3b-b936-890748bfbd77 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:51:52.531801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753930cb-c0f6-4f7f-9025-c464e1121456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:51:52.532435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753930cb-c0f6-4f7f-9025-c464e1121456 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:52.532721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753930cb-c0f6-4f7f-9025-c464e1121456 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:52.532969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753930cb-c0f6-4f7f-9025-c464e1121456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:52.543428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753930cb-c0f6-4f7f-9025-c464e1121456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:51:52.544795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753930cb-c0f6-4f7f-9025-c464e1121456 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:51:52.555725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 768/1537] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:51:54.957990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945322c6-3aa8-4aab-be0b-67c89044fc72 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:54.958939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945322c6-3aa8-4aab-be0b-67c89044fc72 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:54.958939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945322c6-3aa8-4aab-be0b-67c89044fc72 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:54.961738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 770/1538] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 22 19:51:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:51:54.969460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6937-eed0-4f99-80d3-71c4bc55e58f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:54.969957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6937-eed0-4f99-80d3-71c4bc55e58f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:54.970085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6937-eed0-4f99-80d3-71c4bc55e58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:54.994127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-156b6937-eed0-4f99-80d3-71c4bc55e58f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:54.995320 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-156b6937-eed0-4f99-80d3-71c4bc55e58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:55.004105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 769/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 22 19:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:51:55.257783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79f28f-c19d-4abd-bf7d-7396bbfd96f7 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:55.258106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79f28f-c19d-4abd-bf7d-7396bbfd96f7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:55.258376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79f28f-c19d-4abd-bf7d-7396bbfd96f7 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:55.260201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 771/1540] 10.222.0.49 () {54 vars in 962 bytes} [Tue Mar 22 19:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:51:55.265294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa92c21-18fe-4e13-b0bc-a3fad72ada69 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:55.265585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa92c21-18fe-4e13-b0bc-a3fad72ada69 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:55.265858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa92c21-18fe-4e13-b0bc-a3fad72ada69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:55.284557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-baa92c21-18fe-4e13-b0bc-a3fad72ada69 None None] MFA Rules not processed for user `908e60013ebe4372a803a2ae5223e2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:51:55.285771 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-baa92c21-18fe-4e13-b0bc-a3fad72ada69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:51:55.293551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 770/1541] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Mar 22 19:51:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:51:55.303323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79f28f-c19d-4abd-bf7d-7396bbfd96f7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:51:55.314819 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79f28f-c19d-4abd-bf7d-7396bbfd96f7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:51:55.319258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356e590-bba4-4c98-b271-38bc78d871f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:51:55.319926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356e590-bba4-4c98-b271-38bc78d871f0 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:51:55.320236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356e590-bba4-4c98-b271-38bc78d871f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:51:55.320511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356e590-bba4-4c98-b271-38bc78d871f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:51:55.330090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356e590-bba4-4c98-b271-38bc78d871f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:51:55.331538 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356e590-bba4-4c98-b271-38bc78d871f0 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:51:55.340896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 772/1542] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:30.106189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb14b5-9b3e-4d8e-8e97-c34c445cef90 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.107360 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb14b5-9b3e-4d8e-8e97-c34c445cef90 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.108500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb14b5-9b3e-4d8e-8e97-c34c445cef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.116161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c4f0b-5263-476d-9234-2c5ae344cf27 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.117209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c4f0b-5263-476d-9234-2c5ae344cf27 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.117701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c4f0b-5263-476d-9234-2c5ae344cf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.159966 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-500c4f0b-5263-476d-9234-2c5ae344cf27 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.164444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-60bb14b5-9b3e-4d8e-8e97-c34c445cef90 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.166313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-500c4f0b-5263-476d-9234-2c5ae344cf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.167850 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-60bb14b5-9b3e-4d8e-8e97-c34c445cef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.194458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 773/1543] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:53:30.195100 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 771/1544] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:53:30.202008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250f65-cd69-4719-b12e-c4cd6f082eb2 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.202681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250f65-cd69-4719-b12e-c4cd6f082eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.203177 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250f65-cd69-4719-b12e-c4cd6f082eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.215779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d7f1f-31c4-466a-85ce-386bcd0c55ff None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.216474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d7f1f-31c4-466a-85ce-386bcd0c55ff None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.216972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d7f1f-31c4-466a-85ce-386bcd0c55ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.249017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-ee250f65-cd69-4719-b12e-c4cd6f082eb2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.250736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ee250f65-cd69-4719-b12e-c4cd6f082eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.256081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6d1d7f1f-31c4-466a-85ce-386bcd0c55ff None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.263373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6d1d7f1f-31c4-466a-85ce-386bcd0c55ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.269408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 772/1545] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:53:30.271155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba51f-a0b1-47e3-a69c-18a4b9bfe5ab None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.271693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba51f-a0b1-47e3-a69c-18a4b9bfe5ab None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.272276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ba51f-a0b1-47e3-a69c-18a4b9bfe5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.298622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 774/1546] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:53:30.300132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d7f1f-31c4-466a-85ce-386bcd0c55ff None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:30.304163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-725ba51f-a0b1-47e3-a69c-18a4b9bfe5ab None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.305787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-725ba51f-a0b1-47e3-a69c-18a4b9bfe5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.324703 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 773/1547] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:30.326208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ba51f-a0b1-47e3-a69c-18a4b9bfe5ab None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:30.336796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d7f1f-31c4-466a-85ce-386bcd0c55ff None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:30.344934 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ba51f-a0b1-47e3-a69c-18a4b9bfe5ab None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:30.351628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd516090-2f8e-4155-a371-2576a58df51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:30.353398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd516090-2f8e-4155-a371-2576a58df51c admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.354253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd516090-2f8e-4155-a371-2576a58df51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.355330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd516090-2f8e-4155-a371-2576a58df51c admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.356803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8681e-3dc7-4a59-b075-5c473a3ff4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:30.357215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8681e-3dc7-4a59-b075-5c473a3ff4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.357725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8681e-3dc7-4a59-b075-5c473a3ff4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.358275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8681e-3dc7-4a59-b075-5c473a3ff4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.359119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd516090-2f8e-4155-a371-2576a58df51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:30.359362 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8681e-3dc7-4a59-b075-5c473a3ff4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:30.359770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8681e-3dc7-4a59-b075-5c473a3ff4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:30.360306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd516090-2f8e-4155-a371-2576a58df51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:30.361793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8681e-3dc7-4a59-b075-5c473a3ff4f0 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:30.362722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING py.warnings [None req-fd516090-2f8e-4155-a371-2576a58df51c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:53:30.362722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: warnings.warn(msg) Mar 22 19:53:30.362722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: Mar 22 19:53:30.365109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd516090-2f8e-4155-a371-2576a58df51c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:30.394968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 774/1548] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:30.394968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d5df-1346-4e7e-81ab-85c4eaacec66 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.394968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d5df-1346-4e7e-81ab-85c4eaacec66 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.394968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d5df-1346-4e7e-81ab-85c4eaacec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.411955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 775/1549] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:30.413686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33095b-8d19-461f-9c74-23b218db296b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.414257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33095b-8d19-461f-9c74-23b218db296b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.414761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33095b-8d19-461f-9c74-23b218db296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.434663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0e02d5df-1346-4e7e-81ab-85c4eaacec66 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.435955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0e02d5df-1346-4e7e-81ab-85c4eaacec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.453999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 775/1550] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:30.454958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d5df-1346-4e7e-81ab-85c4eaacec66 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:30.455574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-cb33095b-8d19-461f-9c74-23b218db296b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.458217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cb33095b-8d19-461f-9c74-23b218db296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.472246 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d5df-1346-4e7e-81ab-85c4eaacec66 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:30.479926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 776/1551] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:30.481886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33095b-8d19-461f-9c74-23b218db296b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:30.487414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0658d0-c3c6-4ec9-8425-fe370315986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:30.488211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0658d0-c3c6-4ec9-8425-fe370315986c admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.488821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0658d0-c3c6-4ec9-8425-fe370315986c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.489176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0658d0-c3c6-4ec9-8425-fe370315986c admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.489991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0658d0-c3c6-4ec9-8425-fe370315986c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:30.491126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING py.warnings [None req-1c0658d0-c3c6-4ec9-8425-fe370315986c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:53:30.491126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: warnings.warn(msg) Mar 22 19:53:30.491126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: Mar 22 19:53:30.492671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0658d0-c3c6-4ec9-8425-fe370315986c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:30.505038 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33095b-8d19-461f-9c74-23b218db296b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:30.522786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bddd0b-6c34-44fa-9456-381ca4aa460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:30.523950 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bddd0b-6c34-44fa-9456-381ca4aa460f admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.524458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bddd0b-6c34-44fa-9456-381ca4aa460f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.524958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bddd0b-6c34-44fa-9456-381ca4aa460f admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.525913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bddd0b-6c34-44fa-9456-381ca4aa460f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:30.529002 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bddd0b-6c34-44fa-9456-381ca4aa460f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:30.556789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 776/1552] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:30.557590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0658d0-c3c6-4ec9-8425-fe370315986c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:30.612715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 777/1553] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:30.613079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ffab4-b131-42c3-84d4-0e2d83e79223 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.613591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ffab4-b131-42c3-84d4-0e2d83e79223 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.614138 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ffab4-b131-42c3-84d4-0e2d83e79223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.663441 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0658d0-c3c6-4ec9-8425-fe370315986c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:30.676002 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-246ffab4-b131-42c3-84d4-0e2d83e79223 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.680708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-246ffab4-b131-42c3-84d4-0e2d83e79223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.798035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06a462-f6ec-4c83-b4b0-783307df5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:30.799188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06a462-f6ec-4c83-b4b0-783307df5c7f admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.800919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06a462-f6ec-4c83-b4b0-783307df5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.801453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06a462-f6ec-4c83-b4b0-783307df5c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.803239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06a462-f6ec-4c83-b4b0-783307df5c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:30.803986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06a462-f6ec-4c83-b4b0-783307df5c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:30.807333 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06a462-f6ec-4c83-b4b0-783307df5c7f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:30.823267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 778/1554] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:30.824735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ffab4-b131-42c3-84d4-0e2d83e79223 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:30.825401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 777/1555] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:30.829970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559a36-10a2-47a5-a2d5-ec1249e0f794 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.829970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559a36-10a2-47a5-a2d5-ec1249e0f794 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.829970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559a36-10a2-47a5-a2d5-ec1249e0f794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.842499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ffab4-b131-42c3-84d4-0e2d83e79223 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:30.848553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3566c-c24d-4891-a3dc-e63ac1860e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:30.848807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3566c-c24d-4891-a3dc-e63ac1860e30 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.849050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3566c-c24d-4891-a3dc-e63ac1860e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.849267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3566c-c24d-4891-a3dc-e63ac1860e30 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.850001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3566c-c24d-4891-a3dc-e63ac1860e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:30.851401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING py.warnings [None req-9df3566c-c24d-4891-a3dc-e63ac1860e30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:53:30.851401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: warnings.warn(msg) Mar 22 19:53:30.851401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: Mar 22 19:53:30.852998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3566c-c24d-4891-a3dc-e63ac1860e30 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:30.866401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d1559a36-10a2-47a5-a2d5-ec1249e0f794 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.868401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d1559a36-10a2-47a5-a2d5-ec1249e0f794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.878878 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 779/1556] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/users => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:30.879573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3566c-c24d-4891-a3dc-e63ac1860e30 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:30.888568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 778/1557] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:30.890955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245d561-b8cf-4a9d-b55a-f2b21e23d750 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.891461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245d561-b8cf-4a9d-b55a-f2b21e23d750 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.891965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245d561-b8cf-4a9d-b55a-f2b21e23d750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.895455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3566c-c24d-4891-a3dc-e63ac1860e30 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:30.901008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009e0f-f6d7-404b-8871-f2587633bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:30.902043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009e0f-f6d7-404b-8871-f2587633bad1 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.902414 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009e0f-f6d7-404b-8871-f2587633bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.902852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009e0f-f6d7-404b-8871-f2587633bad1 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.903931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b009e0f-f6d7-404b-8871-f2587633bad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:30.906566 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b009e0f-f6d7-404b-8871-f2587633bad1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:30.924692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9245d561-b8cf-4a9d-b55a-f2b21e23d750 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.926829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9245d561-b8cf-4a9d-b55a-f2b21e23d750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.935102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 780/1558] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:30.935102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dc2d5-b67c-45a4-a00b-31c48799d182 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.935102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dc2d5-b67c-45a4-a00b-31c48799d182 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.935102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dc2d5-b67c-45a4-a00b-31c48799d182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.945491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 779/1559] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:30.947037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245d561-b8cf-4a9d-b55a-f2b21e23d750 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:30.957047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-267dc2d5-b67c-45a4-a00b-31c48799d182 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:30.958322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-267dc2d5-b67c-45a4-a00b-31c48799d182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:30.965564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245d561-b8cf-4a9d-b55a-f2b21e23d750 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:30.967301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 781/1560] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:30.968131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dc2d5-b67c-45a4-a00b-31c48799d182 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:30.982995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fc86a-bec5-4047-ba8b-d3e6493b6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:30.983678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fc86a-bec5-4047-ba8b-d3e6493b6d2b admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.983955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fc86a-bec5-4047-ba8b-d3e6493b6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.984222 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fc86a-bec5-4047-ba8b-d3e6493b6d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.984955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fc86a-bec5-4047-ba8b-d3e6493b6d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:30.985146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dc2d5-b67c-45a4-a00b-31c48799d182 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:30.985308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fc86a-bec5-4047-ba8b-d3e6493b6d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:30.987774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fc86a-bec5-4047-ba8b-d3e6493b6d2b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:30.989986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e10403-21a2-491f-a8d8-35e82e19ec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:30.990673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10403-21a2-491f-a8d8-35e82e19ec09 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:30.990976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10403-21a2-491f-a8d8-35e82e19ec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:30.991244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10403-21a2-491f-a8d8-35e82e19ec09 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:30.992104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e10403-21a2-491f-a8d8-35e82e19ec09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:30.994172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e10403-21a2-491f-a8d8-35e82e19ec09 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.004558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 780/1561] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:31.006561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fc86a-bec5-4047-ba8b-d3e6493b6d2b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.023582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fc86a-bec5-4047-ba8b-d3e6493b6d2b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.027912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 782/1562] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:30 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:31.029839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297f77-c3aa-4bef-bbdc-2bb2a4443a00 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.030313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297f77-c3aa-4bef-bbdc-2bb2a4443a00 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.030738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297f77-c3aa-4bef-bbdc-2bb2a4443a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.034060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4354ca1-833b-4dbc-ba68-4053b10bb702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.034760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4354ca1-833b-4dbc-ba68-4053b10bb702 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.035083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4354ca1-833b-4dbc-ba68-4053b10bb702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.035301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4354ca1-833b-4dbc-ba68-4053b10bb702 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.036086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4354ca1-833b-4dbc-ba68-4053b10bb702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.037738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4354ca1-833b-4dbc-ba68-4053b10bb702 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.052739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-5e297f77-c3aa-4bef-bbdc-2bb2a4443a00 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:31.053998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5e297f77-c3aa-4bef-bbdc-2bb2a4443a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:31.056588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 781/1563] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:31.058337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4354ca1-833b-4dbc-ba68-4053b10bb702 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.075732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4354ca1-833b-4dbc-ba68-4053b10bb702 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.145276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 783/1564] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:31.147338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899e49-f41c-4252-9460-6be0dfffde89 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.147618 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899e49-f41c-4252-9460-6be0dfffde89 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.147948 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03899e49-f41c-4252-9460-6be0dfffde89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.167530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ba1f-20a9-4c65-ac63-2237d6180423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.169221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ba1f-20a9-4c65-ac63-2237d6180423 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.169368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ba1f-20a9-4c65-ac63-2237d6180423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.169721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ba1f-20a9-4c65-ac63-2237d6180423 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.170582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ba1f-20a9-4c65-ac63-2237d6180423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.172232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-03899e49-f41c-4252-9460-6be0dfffde89 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:31.172472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ba1f-20a9-4c65-ac63-2237d6180423 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.173660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-03899e49-f41c-4252-9460-6be0dfffde89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:31.183911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 784/1565] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:31.185785 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb69c8-42fe-40eb-ac73-744fdcdb003f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.186172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb69c8-42fe-40eb-ac73-744fdcdb003f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.186509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb69c8-42fe-40eb-ac73-744fdcdb003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.192200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 782/1566] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:31.192200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97a12-09fb-4d8c-bfad-516d4a4eb9c3 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.192623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97a12-09fb-4d8c-bfad-516d4a4eb9c3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.192969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97a12-09fb-4d8c-bfad-516d4a4eb9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.206729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c7cb69c8-42fe-40eb-ac73-744fdcdb003f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:31.207949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c7cb69c8-42fe-40eb-ac73-744fdcdb003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:31.216519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 785/1567] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:31.217374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb69c8-42fe-40eb-ac73-744fdcdb003f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.224573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-40c97a12-09fb-4d8c-bfad-516d4a4eb9c3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:31.226756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-40c97a12-09fb-4d8c-bfad-516d4a4eb9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:31.227502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb69c8-42fe-40eb-ac73-744fdcdb003f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.233743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1a407-43ac-447e-bb2b-cec7453dc7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.234769 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1a407-43ac-447e-bb2b-cec7453dc7ff admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.235216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1a407-43ac-447e-bb2b-cec7453dc7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.235861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1a407-43ac-447e-bb2b-cec7453dc7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.236816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1a407-43ac-447e-bb2b-cec7453dc7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.239052 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1a407-43ac-447e-bb2b-cec7453dc7ff admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.240331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 783/1568] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:31.241898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97a12-09fb-4d8c-bfad-516d4a4eb9c3 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.259229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97a12-09fb-4d8c-bfad-516d4a4eb9c3 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.267528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db1b55-f3c9-4e89-809c-04b08fd91ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.268653 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db1b55-f3c9-4e89-809c-04b08fd91ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.269136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db1b55-f3c9-4e89-809c-04b08fd91ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.269631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db1b55-f3c9-4e89-809c-04b08fd91ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.270948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db1b55-f3c9-4e89-809c-04b08fd91ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.279000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 786/1569] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:31.279292 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db1b55-f3c9-4e89-809c-04b08fd91ff7 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.279498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1a407-43ac-447e-bb2b-cec7453dc7ff admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.302978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 784/1570] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:31.303872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db1b55-f3c9-4e89-809c-04b08fd91ff7 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.314812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db1b55-f3c9-4e89-809c-04b08fd91ff7 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.362815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1a407-43ac-447e-bb2b-cec7453dc7ff admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.367869 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9bd3-eea2-42ea-a1dc-722462a18b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.368584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9bd3-eea2-42ea-a1dc-722462a18b64 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.368884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9bd3-eea2-42ea-a1dc-722462a18b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.369169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9bd3-eea2-42ea-a1dc-722462a18b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.369927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b9bd3-eea2-42ea-a1dc-722462a18b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.371627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b9bd3-eea2-42ea-a1dc-722462a18b64 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.382665 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 787/1571] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:31.383724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9bd3-eea2-42ea-a1dc-722462a18b64 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.397786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9bd3-eea2-42ea-a1dc-722462a18b64 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.403507 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e266583-fdde-4c73-ba41-52ee3060811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.404197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e266583-fdde-4c73-ba41-52ee3060811b admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.404472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e266583-fdde-4c73-ba41-52ee3060811b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.404744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e266583-fdde-4c73-ba41-52ee3060811b admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.405469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e266583-fdde-4c73-ba41-52ee3060811b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:31.405772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e266583-fdde-4c73-ba41-52ee3060811b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.407448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e266583-fdde-4c73-ba41-52ee3060811b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.413231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73879cc5-1fd1-43f9-a2a1-e05167630600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.414319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73879cc5-1fd1-43f9-a2a1-e05167630600 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.414740 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73879cc5-1fd1-43f9-a2a1-e05167630600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.415155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73879cc5-1fd1-43f9-a2a1-e05167630600 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.416446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73879cc5-1fd1-43f9-a2a1-e05167630600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:31.416946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73879cc5-1fd1-43f9-a2a1-e05167630600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.419674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73879cc5-1fd1-43f9-a2a1-e05167630600 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.430190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 788/1572] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:31.430190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e266583-fdde-4c73-ba41-52ee3060811b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.440948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 785/1573] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:31.442053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73879cc5-1fd1-43f9-a2a1-e05167630600 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.444119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e266583-fdde-4c73-ba41-52ee3060811b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.452545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5aa7e6-cfef-4722-8b0d-b2cc77408fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.453682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aa7e6-cfef-4722-8b0d-b2cc77408fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.454186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aa7e6-cfef-4722-8b0d-b2cc77408fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.454532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aa7e6-cfef-4722-8b0d-b2cc77408fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.455350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5aa7e6-cfef-4722-8b0d-b2cc77408fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.457515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5aa7e6-cfef-4722-8b0d-b2cc77408fe9 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.460739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73879cc5-1fd1-43f9-a2a1-e05167630600 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.466395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b4b2e-7e50-4aa6-8bdb-4467dce01904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.467206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b4b2e-7e50-4aa6-8bdb-4467dce01904 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.467663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b4b2e-7e50-4aa6-8bdb-4467dce01904 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.468094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b4b2e-7e50-4aa6-8bdb-4467dce01904 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.469450 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b4b2e-7e50-4aa6-8bdb-4467dce01904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:31.469911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b4b2e-7e50-4aa6-8bdb-4467dce01904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.472099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b4b2e-7e50-4aa6-8bdb-4467dce01904 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.472319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 789/1574] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:31.474032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d407-43d2-41ba-9047-d6a07596d534 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.474559 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d407-43d2-41ba-9047-d6a07596d534 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.475070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d407-43d2-41ba-9047-d6a07596d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.492059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 786/1575] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:31.493167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b4b2e-7e50-4aa6-8bdb-4467dce01904 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.499749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-52e1d407-43d2-41ba-9047-d6a07596d534 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:31.501983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-52e1d407-43d2-41ba-9047-d6a07596d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:31.506411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b4b2e-7e50-4aa6-8bdb-4467dce01904 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.512575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df8743-727a-42dc-b526-29dd4478398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.512891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 790/1576] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:31.513644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df8743-727a-42dc-b526-29dd4478398b admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.514032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d407-43d2-41ba-9047-d6a07596d534 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.514211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df8743-727a-42dc-b526-29dd4478398b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.514531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df8743-727a-42dc-b526-29dd4478398b admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.515717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df8743-727a-42dc-b526-29dd4478398b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.519293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df8743-727a-42dc-b526-29dd4478398b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.529617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d407-43d2-41ba-9047-d6a07596d534 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.536687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757e56e-c643-47e3-959e-d30290662a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.537377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757e56e-c643-47e3-959e-d30290662a60 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.537661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757e56e-c643-47e3-959e-d30290662a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.537967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757e56e-c643-47e3-959e-d30290662a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.538731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757e56e-c643-47e3-959e-d30290662a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.540406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757e56e-c643-47e3-959e-d30290662a60 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.551932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 791/1577] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:31.552252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 787/1578] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/users => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:31.553767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df8743-727a-42dc-b526-29dd4478398b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.555809 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757e56e-c643-47e3-959e-d30290662a60 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.567509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757e56e-c643-47e3-959e-d30290662a60 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.571369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df8743-727a-42dc-b526-29dd4478398b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.572435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcf081-c0da-456a-bddf-1a5d4f137c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.573490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcf081-c0da-456a-bddf-1a5d4f137c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.573754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcf081-c0da-456a-bddf-1a5d4f137c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.574147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcf081-c0da-456a-bddf-1a5d4f137c44 admin admin] PATH_INFO: `/v3/projects/17d755005b5c449193f2694d08939e92/users/5b36116b9d2d4a1785e1be23b434399c/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.579478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941cc9e-eb3d-49b7-b155-963f378256b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.580571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941cc9e-eb3d-49b7-b155-963f378256b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.581036 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941cc9e-eb3d-49b7-b155-963f378256b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.581497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941cc9e-eb3d-49b7-b155-963f378256b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.582833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941cc9e-eb3d-49b7-b155-963f378256b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.586499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941cc9e-eb3d-49b7-b155-963f378256b2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.590910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcf081-c0da-456a-bddf-1a5d4f137c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d755005b5c449193f2694d08939e92, user_id=5b36116b9d2d4a1785e1be23b434399c, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.594630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcf081-c0da-456a-bddf-1a5d4f137c44 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.614724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 792/1579] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:31 2022] PUT /identity/v3/projects/17d755005b5c449193f2694d08939e92/users/5b36116b9d2d4a1785e1be23b434399c/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:31.616168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcf081-c0da-456a-bddf-1a5d4f137c44 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.632972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 788/1580] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:31.634459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941cc9e-eb3d-49b7-b155-963f378256b2 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.698979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcf081-c0da-456a-bddf-1a5d4f137c44 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.727794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941cc9e-eb3d-49b7-b155-963f378256b2 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.734208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fb4ce-fc11-43de-ba6c-2c46cab65eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.735372 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb4ce-fc11-43de-ba6c-2c46cab65eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.735836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb4ce-fc11-43de-ba6c-2c46cab65eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.736307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb4ce-fc11-43de-ba6c-2c46cab65eaa admin admin] PATH_INFO: `/v3/projects/315085e770ff482b82cc030c63c7edab/users/3763d1d3f1cd46058e1979062d084de5/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.768312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fb4ce-fc11-43de-ba6c-2c46cab65eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=315085e770ff482b82cc030c63c7edab, user_id=3763d1d3f1cd46058e1979062d084de5, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.769861 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING py.warnings [None req-d41fb4ce-fc11-43de-ba6c-2c46cab65eaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:53:31.769861 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: warnings.warn(msg) Mar 22 19:53:31.769861 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: Mar 22 19:53:31.772839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fb4ce-fc11-43de-ba6c-2c46cab65eaa admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.782467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81e313-6f8a-4597-9014-aae3f3af6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.783611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81e313-6f8a-4597-9014-aae3f3af6007 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.784100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81e313-6f8a-4597-9014-aae3f3af6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.784659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81e313-6f8a-4597-9014-aae3f3af6007 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.789341 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81e313-6f8a-4597-9014-aae3f3af6007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.791914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81e313-6f8a-4597-9014-aae3f3af6007 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.799102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 789/1581] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:31 2022] PUT /identity/v3/projects/315085e770ff482b82cc030c63c7edab/users/3763d1d3f1cd46058e1979062d084de5/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:31.800401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fb4ce-fc11-43de-ba6c-2c46cab65eaa admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.853929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 793/1582] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/projects => generated 393 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:31.855355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81e313-6f8a-4597-9014-aae3f3af6007 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.876929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fb4ce-fc11-43de-ba6c-2c46cab65eaa admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.943244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149160c-3bf1-48c6-ab3c-65de36abeab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.944153 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149160c-3bf1-48c6-ab3c-65de36abeab0 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.944612 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149160c-3bf1-48c6-ab3c-65de36abeab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.945031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149160c-3bf1-48c6-ab3c-65de36abeab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.945844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149160c-3bf1-48c6-ab3c-65de36abeab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.947843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81e313-6f8a-4597-9014-aae3f3af6007 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:31.948148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149160c-3bf1-48c6-ab3c-65de36abeab0 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.956327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b1860-77b3-4109-a5bc-ef92430d3b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:31.957410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b1860-77b3-4109-a5bc-ef92430d3b45 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:31.957904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b1860-77b3-4109-a5bc-ef92430d3b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:31.958441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b1860-77b3-4109-a5bc-ef92430d3b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:31.959837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b1860-77b3-4109-a5bc-ef92430d3b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:31.960376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b1860-77b3-4109-a5bc-ef92430d3b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:31.963555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b1860-77b3-4109-a5bc-ef92430d3b45 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:31.984365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 790/1583] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:31 2022] POST /identity/v3/projects => generated 405 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:31.984365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149160c-3bf1-48c6-ab3c-65de36abeab0 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.987023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 794/1584] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:31.987853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b1860-77b3-4109-a5bc-ef92430d3b45 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:31.999279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b1860-77b3-4109-a5bc-ef92430d3b45 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.075457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149160c-3bf1-48c6-ab3c-65de36abeab0 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.082819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75996bbd-8aca-4c72-8acb-4d2d8b37a21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.083828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75996bbd-8aca-4c72-8acb-4d2d8b37a21a admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.084183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75996bbd-8aca-4c72-8acb-4d2d8b37a21a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.084559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75996bbd-8aca-4c72-8acb-4d2d8b37a21a admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.085408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75996bbd-8aca-4c72-8acb-4d2d8b37a21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.087211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75996bbd-8aca-4c72-8acb-4d2d8b37a21a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.097553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15bfa6-23b9-4bcb-a17a-3d2baa542f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.098275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15bfa6-23b9-4bcb-a17a-3d2baa542f1b admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.098550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15bfa6-23b9-4bcb-a17a-3d2baa542f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.098823 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15bfa6-23b9-4bcb-a17a-3d2baa542f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.099550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15bfa6-23b9-4bcb-a17a-3d2baa542f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.100761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 791/1585] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.101210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15bfa6-23b9-4bcb-a17a-3d2baa542f1b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.103245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eded9-0385-4f7f-8f2d-3a7482721374 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.103728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eded9-0385-4f7f-8f2d-3a7482721374 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.104207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eded9-0385-4f7f-8f2d-3a7482721374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.113207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 795/1586] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.114122 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15bfa6-23b9-4bcb-a17a-3d2baa542f1b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.127222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15bfa6-23b9-4bcb-a17a-3d2baa542f1b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.129232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4c7eded9-0385-4f7f-8f2d-3a7482721374 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:32.130506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4c7eded9-0385-4f7f-8f2d-3a7482721374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:32.135077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce0ff6-f165-4810-8acd-cd338db75eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.135896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce0ff6-f165-4810-8acd-cd338db75eaa admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.136298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce0ff6-f165-4810-8acd-cd338db75eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.136925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce0ff6-f165-4810-8acd-cd338db75eaa admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.138004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce0ff6-f165-4810-8acd-cd338db75eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.139017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 792/1587] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:32.140316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc0025-7969-4c08-a006-fb1884034010 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.140635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc0025-7969-4c08-a006-fb1884034010 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.140885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc0025-7969-4c08-a006-fb1884034010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.142621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce0ff6-f165-4810-8acd-cd338db75eaa admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.171293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8bbc0025-7969-4c08-a006-fb1884034010 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:32.177636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 796/1588] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:32.178549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8bbc0025-7969-4c08-a006-fb1884034010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:32.178740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce0ff6-f165-4810-8acd-cd338db75eaa admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.189428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 793/1589] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:32.190625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc0025-7969-4c08-a006-fb1884034010 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.191205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce0ff6-f165-4810-8acd-cd338db75eaa admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.199872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9540247-50af-4d50-a6bf-c05adc2a9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.201265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9540247-50af-4d50-a6bf-c05adc2a9bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.201683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9540247-50af-4d50-a6bf-c05adc2a9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.202217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9540247-50af-4d50-a6bf-c05adc2a9bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.203205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9540247-50af-4d50-a6bf-c05adc2a9bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.206210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9540247-50af-4d50-a6bf-c05adc2a9bf7 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.208386 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc0025-7969-4c08-a006-fb1884034010 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.213740 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da793e86-37ab-4a14-be1d-a93bbca86b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.214548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da793e86-37ab-4a14-be1d-a93bbca86b32 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.215035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da793e86-37ab-4a14-be1d-a93bbca86b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.215548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da793e86-37ab-4a14-be1d-a93bbca86b32 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.216598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da793e86-37ab-4a14-be1d-a93bbca86b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.219530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da793e86-37ab-4a14-be1d-a93bbca86b32 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.236829 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 797/1590] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/users => generated 297 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:32.237984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9540247-50af-4d50-a6bf-c05adc2a9bf7 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.248274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 794/1591] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/users => generated 303 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:32.249219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da793e86-37ab-4a14-be1d-a93bbca86b32 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.254204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9540247-50af-4d50-a6bf-c05adc2a9bf7 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.261731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea63eba-5473-4f86-83e3-9649b87a29cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.263031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea63eba-5473-4f86-83e3-9649b87a29cd admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.263485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea63eba-5473-4f86-83e3-9649b87a29cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.263941 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea63eba-5473-4f86-83e3-9649b87a29cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.265106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea63eba-5473-4f86-83e3-9649b87a29cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.265299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da793e86-37ab-4a14-be1d-a93bbca86b32 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.268752 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea63eba-5473-4f86-83e3-9649b87a29cd admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.272675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a79a-224d-4f66-a9ce-da6df660011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.273505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a79a-224d-4f66-a9ce-da6df660011e admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.273990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a79a-224d-4f66-a9ce-da6df660011e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.274410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a79a-224d-4f66-a9ce-da6df660011e admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.275389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50a79a-224d-4f66-a9ce-da6df660011e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.277704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50a79a-224d-4f66-a9ce-da6df660011e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.290469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 795/1592] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.291437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a79a-224d-4f66-a9ce-da6df660011e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.302423 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a79a-224d-4f66-a9ce-da6df660011e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.308697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606e98f-ee68-410c-be04-9b8984a4a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.310389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606e98f-ee68-410c-be04-9b8984a4a06f admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.312250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 798/1593] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:32.312481 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606e98f-ee68-410c-be04-9b8984a4a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.312747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606e98f-ee68-410c-be04-9b8984a4a06f admin admin] PATH_INFO: `/v3/projects/ccb76eb4a9914e76b9035ee16d5c8075/users/e35d1daac2664b94af237e40db21d3a3/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.314657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea63eba-5473-4f86-83e3-9649b87a29cd admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.338412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606e98f-ee68-410c-be04-9b8984a4a06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb76eb4a9914e76b9035ee16d5c8075, user_id=e35d1daac2664b94af237e40db21d3a3, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.343317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606e98f-ee68-410c-be04-9b8984a4a06f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.365685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 796/1594] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:32 2022] PUT /identity/v3/projects/ccb76eb4a9914e76b9035ee16d5c8075/users/e35d1daac2664b94af237e40db21d3a3/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:32.367113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606e98f-ee68-410c-be04-9b8984a4a06f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.409165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea63eba-5473-4f86-83e3-9649b87a29cd admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.460264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606e98f-ee68-410c-be04-9b8984a4a06f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.467609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e38375-6bf5-461f-a33b-4cc4c80d8b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.468981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38375-6bf5-461f-a33b-4cc4c80d8b50 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.469626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38375-6bf5-461f-a33b-4cc4c80d8b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.469888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38375-6bf5-461f-a33b-4cc4c80d8b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.470975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e38375-6bf5-461f-a33b-4cc4c80d8b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.473767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e38375-6bf5-461f-a33b-4cc4c80d8b50 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.481667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771a8f9-2659-4f1a-ba9f-00822c3e6485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.482734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771a8f9-2659-4f1a-ba9f-00822c3e6485 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.483154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771a8f9-2659-4f1a-ba9f-00822c3e6485 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.483481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771a8f9-2659-4f1a-ba9f-00822c3e6485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.491661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 797/1595] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.492819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e38375-6bf5-461f-a33b-4cc4c80d8b50 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.499040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771a8f9-2659-4f1a-ba9f-00822c3e6485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.501595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771a8f9-2659-4f1a-ba9f-00822c3e6485 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.508279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e38375-6bf5-461f-a33b-4cc4c80d8b50 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.513040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3544b-ab88-4f13-8056-9192cd8c94dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.513836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3544b-ab88-4f13-8056-9192cd8c94dd service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.514296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3544b-ab88-4f13-8056-9192cd8c94dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.514755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3544b-ab88-4f13-8056-9192cd8c94dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.517537 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 799/1596] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:32.519028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771a8f9-2659-4f1a-ba9f-00822c3e6485 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.531666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3544b-ab88-4f13-8056-9192cd8c94dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.534385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3544b-ab88-4f13-8056-9192cd8c94dd service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.536798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771a8f9-2659-4f1a-ba9f-00822c3e6485 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.543521 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80fcca-23e3-4c1a-8160-ddca729b0c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.544170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80fcca-23e3-4c1a-8160-ddca729b0c85 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.544555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80fcca-23e3-4c1a-8160-ddca729b0c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.544921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80fcca-23e3-4c1a-8160-ddca729b0c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.545833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80fcca-23e3-4c1a-8160-ddca729b0c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.547721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80fcca-23e3-4c1a-8160-ddca729b0c85 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.555163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 798/1597] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:32.557861 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3544b-ab88-4f13-8056-9192cd8c94dd service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.559897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 800/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.560780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80fcca-23e3-4c1a-8160-ddca729b0c85 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.575932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80fcca-23e3-4c1a-8160-ddca729b0c85 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.577433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3544b-ab88-4f13-8056-9192cd8c94dd service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.582026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd5a41-da83-45b0-a618-12b4d00ecbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.583843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd5a41-da83-45b0-a618-12b4d00ecbd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.584345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd5a41-da83-45b0-a618-12b4d00ecbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.584913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd5a41-da83-45b0-a618-12b4d00ecbd5 admin admin] PATH_INFO: `/v3/projects/9a67309e48e0450c9eaff21ba9315b62/users/d567258032bd493eb8bedaaeda849d7c/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.586060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4faa9-738f-475f-b2d1-d036041e6455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.586933 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4faa9-738f-475f-b2d1-d036041e6455 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.587278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4faa9-738f-475f-b2d1-d036041e6455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.587626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4faa9-738f-475f-b2d1-d036041e6455 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.588431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4faa9-738f-475f-b2d1-d036041e6455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.590854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4faa9-738f-475f-b2d1-d036041e6455 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.603122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 799/1599] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.604382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4faa9-738f-475f-b2d1-d036041e6455 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.616666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4faa9-738f-475f-b2d1-d036041e6455 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.623537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56efedb-48de-49ce-90f2-f5cdd9f1d702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.624717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56efedb-48de-49ce-90f2-f5cdd9f1d702 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.625192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd5a41-da83-45b0-a618-12b4d00ecbd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a67309e48e0450c9eaff21ba9315b62, user_id=d567258032bd493eb8bedaaeda849d7c, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.625392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56efedb-48de-49ce-90f2-f5cdd9f1d702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.625583 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56efedb-48de-49ce-90f2-f5cdd9f1d702 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.627212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56efedb-48de-49ce-90f2-f5cdd9f1d702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.628672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56efedb-48de-49ce-90f2-f5cdd9f1d702 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.631739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd5a41-da83-45b0-a618-12b4d00ecbd5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.657848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 800/1600] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:32.657848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2665dc-3137-4a69-b8e2-452932e2baf9 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.657848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2665dc-3137-4a69-b8e2-452932e2baf9 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.657848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2665dc-3137-4a69-b8e2-452932e2baf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.666084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 801/1601] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:32 2022] PUT /identity/v3/projects/9a67309e48e0450c9eaff21ba9315b62/users/d567258032bd493eb8bedaaeda849d7c/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:32.668331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd5a41-da83-45b0-a618-12b4d00ecbd5 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.691086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3c2665dc-3137-4a69-b8e2-452932e2baf9 None None] MFA Rules not processed for user `e35d1daac2664b94af237e40db21d3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:32.693509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3c2665dc-3137-4a69-b8e2-452932e2baf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:32.791936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd5a41-da83-45b0-a618-12b4d00ecbd5 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.803388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 801/1602] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:32.803636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c5665-ecb1-4249-b9ea-b1dc99737fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.803752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2665dc-3137-4a69-b8e2-452932e2baf9 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.803838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c5665-ecb1-4249-b9ea-b1dc99737fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.803838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c5665-ecb1-4249-b9ea-b1dc99737fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.803838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c5665-ecb1-4249-b9ea-b1dc99737fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.804888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c5665-ecb1-4249-b9ea-b1dc99737fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.809878 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c5665-ecb1-4249-b9ea-b1dc99737fc3 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.823785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2665dc-3137-4a69-b8e2-452932e2baf9 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.832532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193890bc-059e-4127-ac4a-331a8afab5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.836825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193890bc-059e-4127-ac4a-331a8afab5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.836825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193890bc-059e-4127-ac4a-331a8afab5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.836825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193890bc-059e-4127-ac4a-331a8afab5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.837220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 802/1603] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.837304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193890bc-059e-4127-ac4a-331a8afab5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.837386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c5665-ecb1-4249-b9ea-b1dc99737fc3 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.839571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193890bc-059e-4127-ac4a-331a8afab5d8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.853904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c5665-ecb1-4249-b9ea-b1dc99737fc3 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.861905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f1a95-8515-472e-a511-2d4ab3ad726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.862517 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 802/1604] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.863985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193890bc-059e-4127-ac4a-331a8afab5d8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.868228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1a95-8515-472e-a511-2d4ab3ad726b admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.868728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1a95-8515-472e-a511-2d4ab3ad726b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.869212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1a95-8515-472e-a511-2d4ab3ad726b admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.870619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f1a95-8515-472e-a511-2d4ab3ad726b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.873762 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f1a95-8515-472e-a511-2d4ab3ad726b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.882413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193890bc-059e-4127-ac4a-331a8afab5d8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.890477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88382991-f799-480c-bf2e-27245704fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.891628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88382991-f799-480c-bf2e-27245704fa60 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.892435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88382991-f799-480c-bf2e-27245704fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.892583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 803/1605] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.892678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88382991-f799-480c-bf2e-27245704fa60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.894152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88382991-f799-480c-bf2e-27245704fa60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.894592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4686-c748-4b4a-b16b-4a78e3975cf0 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.895107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4686-c748-4b4a-b16b-4a78e3975cf0 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.895621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4686-c748-4b4a-b16b-4a78e3975cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.897290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88382991-f799-480c-bf2e-27245704fa60 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.913984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 803/1606] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:32.915260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88382991-f799-480c-bf2e-27245704fa60 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:32.928017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88382991-f799-480c-bf2e-27245704fa60 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:32.934274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba9d7-25d0-4395-ba09-135abea49e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:32.935771 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba9d7-25d0-4395-ba09-135abea49e43 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:32.936168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba9d7-25d0-4395-ba09-135abea49e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:32.936533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba9d7-25d0-4395-ba09-135abea49e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:32.938537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ba9d7-25d0-4395-ba09-135abea49e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:32.940686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ba9d7-25d0-4395-ba09-135abea49e43 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:32.951352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-162b4686-c748-4b4a-b16b-4a78e3975cf0 None None] MFA Rules not processed for user `d567258032bd493eb8bedaaeda849d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:32.953578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-162b4686-c748-4b4a-b16b-4a78e3975cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:32.990030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 804/1607] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:32.991051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba9d7-25d0-4395-ba09-135abea49e43 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:33.080858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 804/1608] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:33.082054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b4686-c748-4b4a-b16b-4a78e3975cf0 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:33.097962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b4686-c748-4b4a-b16b-4a78e3975cf0 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:33.172554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba9d7-25d0-4395-ba09-135abea49e43 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:33.183059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7bcc-a972-4647-a208-57755ef6a143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:33.188016 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7bcc-a972-4647-a208-57755ef6a143 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.188648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7bcc-a972-4647-a208-57755ef6a143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.189243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7bcc-a972-4647-a208-57755ef6a143 admin admin] PATH_INFO: `/v3/projects/5b2b44d95eff408ab0bd9a23123f5158/users/9680269cd8504c36b6027040e185a817/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.229876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc400df7-f2a1-4a33-9f7a-2825c1476582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:33.230539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a7bcc-a972-4647-a208-57755ef6a143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2b44d95eff408ab0bd9a23123f5158, user_id=9680269cd8504c36b6027040e185a817, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:33.231030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400df7-f2a1-4a33-9f7a-2825c1476582 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.231316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400df7-f2a1-4a33-9f7a-2825c1476582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.231595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400df7-f2a1-4a33-9f7a-2825c1476582 admin admin] PATH_INFO: `/v3/projects/09fa13f497274b059b64db9cafbf68cd/users/0207c3cb9a3e408f81ff3f86c5e70285/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.238211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a7bcc-a972-4647-a208-57755ef6a143 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:33.257958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc400df7-f2a1-4a33-9f7a-2825c1476582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fa13f497274b059b64db9cafbf68cd, user_id=0207c3cb9a3e408f81ff3f86c5e70285, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:33.261678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc400df7-f2a1-4a33-9f7a-2825c1476582 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:33.284307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 805/1609] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:32 2022] PUT /identity/v3/projects/5b2b44d95eff408ab0bd9a23123f5158/users/9680269cd8504c36b6027040e185a817/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:33.286050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7bcc-a972-4647-a208-57755ef6a143 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:33.291635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 805/1610] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:33 2022] PUT /identity/v3/projects/09fa13f497274b059b64db9cafbf68cd/users/0207c3cb9a3e408f81ff3f86c5e70285/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:33.296239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc400df7-f2a1-4a33-9f7a-2825c1476582 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:33.417643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc400df7-f2a1-4a33-9f7a-2825c1476582 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:33.424038 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81089ff-3115-46dc-9059-9437512ace88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:33.424860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81089ff-3115-46dc-9059-9437512ace88 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.425322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81089ff-3115-46dc-9059-9437512ace88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.425514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81089ff-3115-46dc-9059-9437512ace88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.426363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81089ff-3115-46dc-9059-9437512ace88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:33.428165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81089ff-3115-46dc-9059-9437512ace88 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:33.443643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 806/1611] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:33.444778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81089ff-3115-46dc-9059-9437512ace88 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:33.456620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81089ff-3115-46dc-9059-9437512ace88 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:33.459018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7bcc-a972-4647-a208-57755ef6a143 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:33.461873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad047b0e-bf84-437b-8701-669a1517d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:33.462739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad047b0e-bf84-437b-8701-669a1517d1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.463028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad047b0e-bf84-437b-8701-669a1517d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.463308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad047b0e-bf84-437b-8701-669a1517d1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.464125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad047b0e-bf84-437b-8701-669a1517d1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:33.466283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad047b0e-bf84-437b-8701-669a1517d1b5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:33.471067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b264df-139a-42ba-bac1-610b3fe011e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:33.473231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b264df-139a-42ba-bac1-610b3fe011e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.474004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b264df-139a-42ba-bac1-610b3fe011e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.474705 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b264df-139a-42ba-bac1-610b3fe011e0 admin admin] PATH_INFO: `/v3/projects/594ac98f148e4aa5b1a84afc8bbd39dc/users/cc6cb9a3747b4fadacbf3ad4e89a8ef2/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.493599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 807/1612] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:33 2022] POST /identity/v3/users => generated 298 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:33.494949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad047b0e-bf84-437b-8701-669a1517d1b5 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:33.504736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b264df-139a-42ba-bac1-610b3fe011e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594ac98f148e4aa5b1a84afc8bbd39dc, user_id=cc6cb9a3747b4fadacbf3ad4e89a8ef2, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:33.510846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b264df-139a-42ba-bac1-610b3fe011e0 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:33.518983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad047b0e-bf84-437b-8701-669a1517d1b5 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:33.526976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def88ca2-69eb-4a1c-850c-48f5756d771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:33.527944 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def88ca2-69eb-4a1c-850c-48f5756d771c admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.528109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def88ca2-69eb-4a1c-850c-48f5756d771c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.528406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def88ca2-69eb-4a1c-850c-48f5756d771c admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.529310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def88ca2-69eb-4a1c-850c-48f5756d771c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:33.531358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def88ca2-69eb-4a1c-850c-48f5756d771c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:33.555534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 806/1613] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:33 2022] PUT /identity/v3/projects/594ac98f148e4aa5b1a84afc8bbd39dc/users/cc6cb9a3747b4fadacbf3ad4e89a8ef2/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:33.566247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbab9b6-fbe5-470c-a4e0-6ed052d271a3 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.566949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbab9b6-fbe5-470c-a4e0-6ed052d271a3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.567386 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbab9b6-fbe5-470c-a4e0-6ed052d271a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.585789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 808/1614] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:33 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:33.587817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361972-481d-4f1b-9aef-81a5f42a14c6 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.588293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361972-481d-4f1b-9aef-81a5f42a14c6 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.588717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361972-481d-4f1b-9aef-81a5f42a14c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.606369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-2fbab9b6-fbe5-470c-a4e0-6ed052d271a3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:33.608681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2fbab9b6-fbe5-470c-a4e0-6ed052d271a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:33.618935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4d361972-481d-4f1b-9aef-81a5f42a14c6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:33.622105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4d361972-481d-4f1b-9aef-81a5f42a14c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:33.723399 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 807/1615] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:33.729879 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbab9b6-fbe5-470c-a4e0-6ed052d271a3 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:33.744996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbab9b6-fbe5-470c-a4e0-6ed052d271a3 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:33.751957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926cc79-a141-4e92-a61a-eb922e626e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:33.752974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926cc79-a141-4e92-a61a-eb922e626e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.753420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926cc79-a141-4e92-a61a-eb922e626e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.753701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926cc79-a141-4e92-a61a-eb922e626e6e admin admin] PATH_INFO: `/v3/projects/95235f7bc3c14d0ab8101f7e805e9921/users/918310d4fbc047d493f7c9a1157c2f66/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.779505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926cc79-a141-4e92-a61a-eb922e626e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95235f7bc3c14d0ab8101f7e805e9921, user_id=918310d4fbc047d493f7c9a1157c2f66, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:33.786426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926cc79-a141-4e92-a61a-eb922e626e6e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:33.818056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 808/1616] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:33 2022] PUT /identity/v3/projects/95235f7bc3c14d0ab8101f7e805e9921/users/918310d4fbc047d493f7c9a1157c2f66/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:33.819221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 809/1617] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:33.820298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926cc79-a141-4e92-a61a-eb922e626e6e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:33.822440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d008-da9e-444c-89e8-c380d62e596b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.823018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d008-da9e-444c-89e8-c380d62e596b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.823509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d008-da9e-444c-89e8-c380d62e596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.879930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a487d008-da9e-444c-89e8-c380d62e596b None None] MFA Rules not processed for user `cc6cb9a3747b4fadacbf3ad4e89a8ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:33.882145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a487d008-da9e-444c-89e8-c380d62e596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:33.943969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926cc79-a141-4e92-a61a-eb922e626e6e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:33.955469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72eb9d-43d1-4805-8d98-cf9aa390ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:33.957617 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72eb9d-43d1-4805-8d98-cf9aa390ca49 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:33.958065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72eb9d-43d1-4805-8d98-cf9aa390ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:33.958448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72eb9d-43d1-4805-8d98-cf9aa390ca49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:33.959323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72eb9d-43d1-4805-8d98-cf9aa390ca49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:33.962768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72eb9d-43d1-4805-8d98-cf9aa390ca49 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:33.982047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 809/1618] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:33.982047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72eb9d-43d1-4805-8d98-cf9aa390ca49 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:33.997152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72eb9d-43d1-4805-8d98-cf9aa390ca49 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.005785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093cbeb-b3b3-4ce9-916a-852d3b48721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.008220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093cbeb-b3b3-4ce9-916a-852d3b48721e admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.009275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093cbeb-b3b3-4ce9-916a-852d3b48721e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.010268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093cbeb-b3b3-4ce9-916a-852d3b48721e admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.012390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093cbeb-b3b3-4ce9-916a-852d3b48721e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.018310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093cbeb-b3b3-4ce9-916a-852d3b48721e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.040615 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 810/1619] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:34.041967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb478c7-b2e1-4f02-ad44-50acf0b1f68f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.042458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb478c7-b2e1-4f02-ad44-50acf0b1f68f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.042906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb478c7-b2e1-4f02-ad44-50acf0b1f68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.058463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 810/1620] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:33 2022] POST /identity/v3/users => generated 297 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:34.069866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093cbeb-b3b3-4ce9-916a-852d3b48721e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:34.088907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-bcb478c7-b2e1-4f02-ad44-50acf0b1f68f None None] MFA Rules not processed for user `5b36116b9d2d4a1785e1be23b434399c`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:34.090451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-bcb478c7-b2e1-4f02-ad44-50acf0b1f68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:34.155791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093cbeb-b3b3-4ce9-916a-852d3b48721e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.160392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90196fde-014e-4a51-8401-f7cb513772ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.161078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90196fde-014e-4a51-8401-f7cb513772ae service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.161357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90196fde-014e-4a51-8401-f7cb513772ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.161630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90196fde-014e-4a51-8401-f7cb513772ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.173760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90196fde-014e-4a51-8401-f7cb513772ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.175521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90196fde-014e-4a51-8401-f7cb513772ae service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.188798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 811/1621] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:34.190238 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700b4b7-3092-4d00-ad5e-a7e69affabcb None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.190714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700b4b7-3092-4d00-ad5e-a7e69affabcb None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.190996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700b4b7-3092-4d00-ad5e-a7e69affabcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.195669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 811/1622] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:34.196469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb478c7-b2e1-4f02-ad44-50acf0b1f68f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:34.217253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb478c7-b2e1-4f02-ad44-50acf0b1f68f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.224872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c86f09-194f-4ee6-8959-e9786115adc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.225743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c86f09-194f-4ee6-8959-e9786115adc7 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.226177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c86f09-194f-4ee6-8959-e9786115adc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.226563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c86f09-194f-4ee6-8959-e9786115adc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.233652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c700b4b7-3092-4d00-ad5e-a7e69affabcb None None] MFA Rules not processed for user `918310d4fbc047d493f7c9a1157c2f66`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:34.235118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c700b4b7-3092-4d00-ad5e-a7e69affabcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:34.241770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c86f09-194f-4ee6-8959-e9786115adc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.244265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c86f09-194f-4ee6-8959-e9786115adc7 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.258403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 812/1623] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:34.259603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c86f09-194f-4ee6-8959-e9786115adc7 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:34.271481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c86f09-194f-4ee6-8959-e9786115adc7 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.277535 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71be62-12cd-4cd3-a5a3-4be3a15c7bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.278633 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71be62-12cd-4cd3-a5a3-4be3a15c7bce admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.279060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71be62-12cd-4cd3-a5a3-4be3a15c7bce admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.279501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71be62-12cd-4cd3-a5a3-4be3a15c7bce admin admin] PATH_INFO: `/v3/projects/07399cd228ea45cc8e378300c1ef2e43/users/1698cabe93cf42a4839b446c4fa64ab4/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.299145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71be62-12cd-4cd3-a5a3-4be3a15c7bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=07399cd228ea45cc8e378300c1ef2e43, user_id=1698cabe93cf42a4839b446c4fa64ab4, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.304475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71be62-12cd-4cd3-a5a3-4be3a15c7bce admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.322937 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 812/1624] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:34.324449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700b4b7-3092-4d00-ad5e-a7e69affabcb None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:34.337819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700b4b7-3092-4d00-ad5e-a7e69affabcb None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.340422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 813/1625] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:34 2022] PUT /identity/v3/projects/07399cd228ea45cc8e378300c1ef2e43/users/1698cabe93cf42a4839b446c4fa64ab4/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:34.343231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71be62-12cd-4cd3-a5a3-4be3a15c7bce admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:34.479942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71be62-12cd-4cd3-a5a3-4be3a15c7bce admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.485329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09ffe4-1ead-40f4-987b-5f36a0a320d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.486061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09ffe4-1ead-40f4-987b-5f36a0a320d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.486351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09ffe4-1ead-40f4-987b-5f36a0a320d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.486630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09ffe4-1ead-40f4-987b-5f36a0a320d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.486737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c245f-3b2e-486b-b5fe-eca67434016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.487354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09ffe4-1ead-40f4-987b-5f36a0a320d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.488762 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c245f-3b2e-486b-b5fe-eca67434016d admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.488762 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c245f-3b2e-486b-b5fe-eca67434016d admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.488996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c245f-3b2e-486b-b5fe-eca67434016d admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.489352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09ffe4-1ead-40f4-987b-5f36a0a320d8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.490217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c245f-3b2e-486b-b5fe-eca67434016d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.492715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c245f-3b2e-486b-b5fe-eca67434016d admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.508287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 814/1626] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:34.508287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab1409-3bd6-4db1-a4c1-12da06e44bdf None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.508287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab1409-3bd6-4db1-a4c1-12da06e44bdf None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.508670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab1409-3bd6-4db1-a4c1-12da06e44bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.531750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c3ab1409-3bd6-4db1-a4c1-12da06e44bdf None None] MFA Rules not processed for user `5b36116b9d2d4a1785e1be23b434399c`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:34.533273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c3ab1409-3bd6-4db1-a4c1-12da06e44bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:34.558204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 813/1627] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:34 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:34.559500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09ffe4-1ead-40f4-987b-5f36a0a320d8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:34.639460 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 815/1628] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:34.640375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab1409-3bd6-4db1-a4c1-12da06e44bdf None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:34.666051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab1409-3bd6-4db1-a4c1-12da06e44bdf None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.706169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09ffe4-1ead-40f4-987b-5f36a0a320d8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.716359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e07c7-9a26-4a4c-a890-a14226a407b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.718203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e07c7-9a26-4a4c-a890-a14226a407b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.718948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e07c7-9a26-4a4c-a890-a14226a407b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.719356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e07c7-9a26-4a4c-a890-a14226a407b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.720297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e07c7-9a26-4a4c-a890-a14226a407b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.723511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e07c7-9a26-4a4c-a890-a14226a407b8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.777274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3281c5b-c1d0-4bd2-a415-ba20aceedaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.778352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3281c5b-c1d0-4bd2-a415-ba20aceedaba admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.778787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3281c5b-c1d0-4bd2-a415-ba20aceedaba admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.779346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3281c5b-c1d0-4bd2-a415-ba20aceedaba admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.780559 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3281c5b-c1d0-4bd2-a415-ba20aceedaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.782858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3281c5b-c1d0-4bd2-a415-ba20aceedaba admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.789165 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 814/1629] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:34 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:34.790235 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e07c7-9a26-4a4c-a890-a14226a407b8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:34.804091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 816/1630] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:34.805551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3281c5b-c1d0-4bd2-a415-ba20aceedaba admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:34.817474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3281c5b-c1d0-4bd2-a415-ba20aceedaba admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.906300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e07c7-9a26-4a4c-a890-a14226a407b8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:34.915842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada966b1-67a4-4222-a5fc-8fac1b970b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.917328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada966b1-67a4-4222-a5fc-8fac1b970b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.918086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada966b1-67a4-4222-a5fc-8fac1b970b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.919070 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada966b1-67a4-4222-a5fc-8fac1b970b3a admin admin] PATH_INFO: `/v3/projects/77f68210321d4532ba50492ddaeb4142/users/e66ca45068ad4bbd8cb10c348d4c1ddf/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.924108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0459c-faec-4ddc-85d3-f22d9d566945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:34.924108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0459c-faec-4ddc-85d3-f22d9d566945 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.924108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0459c-faec-4ddc-85d3-f22d9d566945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.924108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0459c-faec-4ddc-85d3-f22d9d566945 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.924790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0459c-faec-4ddc-85d3-f22d9d566945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.929004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0459c-faec-4ddc-85d3-f22d9d566945 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.954836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada966b1-67a4-4222-a5fc-8fac1b970b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f68210321d4532ba50492ddaeb4142, user_id=e66ca45068ad4bbd8cb10c348d4c1ddf, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:34.958387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada966b1-67a4-4222-a5fc-8fac1b970b3a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:34.974136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 817/1631] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:34 2022] POST /identity/v3/users => generated 309 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:34.978100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c86722-a442-4274-97db-400e93751be0 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:34.978333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c86722-a442-4274-97db-400e93751be0 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:34.978565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c86722-a442-4274-97db-400e93751be0 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:34.980762 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 818/1632] 10.222.0.49 () {54 vars in 959 bytes} [Tue Mar 22 19:53:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:53:34.983501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c86722-a442-4274-97db-400e93751be0 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:35.001685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 815/1633] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:34 2022] PUT /identity/v3/projects/77f68210321d4532ba50492ddaeb4142/users/e66ca45068ad4bbd8cb10c348d4c1ddf/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:35.005496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada966b1-67a4-4222-a5fc-8fac1b970b3a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:35.021817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c86722-a442-4274-97db-400e93751be0 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:35.132077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada966b1-67a4-4222-a5fc-8fac1b970b3a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:35.138442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160587e1-71a6-4ae2-83e1-8d0f2550129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:35.139391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160587e1-71a6-4ae2-83e1-8d0f2550129f admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.139651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160587e1-71a6-4ae2-83e1-8d0f2550129f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.140795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160587e1-71a6-4ae2-83e1-8d0f2550129f admin admin] PATH_INFO: `/v3/projects/07399cd228ea45cc8e378300c1ef2e43/users/1698cabe93cf42a4839b446c4fa64ab4/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.143820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160587e1-71a6-4ae2-83e1-8d0f2550129f admin admin] RBAC: Authorizing `identity:create_grant(project_id=07399cd228ea45cc8e378300c1ef2e43, user_id=1698cabe93cf42a4839b446c4fa64ab4, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:35.147074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160587e1-71a6-4ae2-83e1-8d0f2550129f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:35.155230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9652cc-77a4-4809-bde4-a2f7240d4e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:35.156440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9652cc-77a4-4809-bde4-a2f7240d4e9a admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.156945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9652cc-77a4-4809-bde4-a2f7240d4e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.157439 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9652cc-77a4-4809-bde4-a2f7240d4e9a admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.158695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9652cc-77a4-4809-bde4-a2f7240d4e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:35.169913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 816/1634] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:35 2022] PUT /identity/v3/projects/07399cd228ea45cc8e378300c1ef2e43/users/1698cabe93cf42a4839b446c4fa64ab4/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:35.169913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160587e1-71a6-4ae2-83e1-8d0f2550129f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:35.172201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9652cc-77a4-4809-bde4-a2f7240d4e9a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:35.207473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 819/1635] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:34 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:35.211690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be451c9-7c8b-42b3-99e2-ac8673fb6e5d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.212644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be451c9-7c8b-42b3-99e2-ac8673fb6e5d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.213232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be451c9-7c8b-42b3-99e2-ac8673fb6e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.260940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-3be451c9-7c8b-42b3-99e2-ac8673fb6e5d None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:35.262930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3be451c9-7c8b-42b3-99e2-ac8673fb6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:35.271036 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160587e1-71a6-4ae2-83e1-8d0f2550129f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:35.289259 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672fa3-b063-4d45-81a2-281578a9aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:35.290363 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672fa3-b063-4d45-81a2-281578a9aa4d admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.290693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672fa3-b063-4d45-81a2-281578a9aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.291013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672fa3-b063-4d45-81a2-281578a9aa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.291829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18672fa3-b063-4d45-81a2-281578a9aa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:35.296803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18672fa3-b063-4d45-81a2-281578a9aa4d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:35.331169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 817/1636] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:35.331169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672fa3-b063-4d45-81a2-281578a9aa4d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:35.359805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672fa3-b063-4d45-81a2-281578a9aa4d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:35.374087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5efa24-294e-465b-9e7a-46953df4dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:35.374808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5efa24-294e-465b-9e7a-46953df4dd55 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.375087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5efa24-294e-465b-9e7a-46953df4dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.375355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5efa24-294e-465b-9e7a-46953df4dd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.380736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5efa24-294e-465b-9e7a-46953df4dd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:35.385123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5efa24-294e-465b-9e7a-46953df4dd55 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:35.410935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 820/1637] 10.222.0.49 () {58 vars in 1056 bytes} [Tue Mar 22 19:53:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:35.413472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabaa7-146a-4b38-ab50-985aa6e3ef21 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.413743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabaa7-146a-4b38-ab50-985aa6e3ef21 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.414045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabaa7-146a-4b38-ab50-985aa6e3ef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.444358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 818/1638] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:35.450986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5efa24-294e-465b-9e7a-46953df4dd55 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:35.452697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-1ffabaa7-146a-4b38-ab50-985aa6e3ef21 None None] MFA Rules not processed for user `1698cabe93cf42a4839b446c4fa64ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:35.454169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1ffabaa7-146a-4b38-ab50-985aa6e3ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:35.489765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5efa24-294e-465b-9e7a-46953df4dd55 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:35.506748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f21d94-01bf-45b4-b5a8-2ed909621dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:35.510113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f21d94-01bf-45b4-b5a8-2ed909621dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.510660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f21d94-01bf-45b4-b5a8-2ed909621dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.511019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f21d94-01bf-45b4-b5a8-2ed909621dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.512269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f21d94-01bf-45b4-b5a8-2ed909621dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:35.517680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f21d94-01bf-45b4-b5a8-2ed909621dd8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:35.546975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 819/1639] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:35.548026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f21d94-01bf-45b4-b5a8-2ed909621dd8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:35.573909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 821/1640] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:35.573909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabaa7-146a-4b38-ab50-985aa6e3ef21 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:35.577485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f21d94-01bf-45b4-b5a8-2ed909621dd8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:35.591116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e94ec2-1f95-4b51-b5a0-d9e48c055680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:35.592007 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e94ec2-1f95-4b51-b5a0-d9e48c055680 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.592278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e94ec2-1f95-4b51-b5a0-d9e48c055680 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.592546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e94ec2-1f95-4b51-b5a0-d9e48c055680 admin admin] PATH_INFO: `/v3/projects/ce3d042d53ed489aacc2e9f757db70d1/users/f3e00b19d3ad44b5a1f88129b862bc46/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.595473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabaa7-146a-4b38-ab50-985aa6e3ef21 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:35.616367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a2524-42b5-41b3-b382-66915965f581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:35.617668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a2524-42b5-41b3-b382-66915965f581 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.622720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a2524-42b5-41b3-b382-66915965f581 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.623101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a2524-42b5-41b3-b382-66915965f581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.632390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e94ec2-1f95-4b51-b5a0-d9e48c055680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3d042d53ed489aacc2e9f757db70d1, user_id=f3e00b19d3ad44b5a1f88129b862bc46, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:35.635686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e94ec2-1f95-4b51-b5a0-d9e48c055680 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:35.666316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 820/1641] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:35 2022] PUT /identity/v3/projects/ce3d042d53ed489aacc2e9f757db70d1/users/f3e00b19d3ad44b5a1f88129b862bc46/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:35.669568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e94ec2-1f95-4b51-b5a0-d9e48c055680 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:35.744711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a2524-42b5-41b3-b382-66915965f581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:35.748240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a2524-42b5-41b3-b382-66915965f581 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:35.768797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 822/1642] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:35.770197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a2524-42b5-41b3-b382-66915965f581 service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:35.798353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a2524-42b5-41b3-b382-66915965f581 service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:35.855901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e94ec2-1f95-4b51-b5a0-d9e48c055680 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:35.885011 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fb9f4-9274-4d5c-9249-11f3c6a3e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:35.890646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fb9f4-9274-4d5c-9249-11f3c6a3e462 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:35.891322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fb9f4-9274-4d5c-9249-11f3c6a3e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:35.891810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fb9f4-9274-4d5c-9249-11f3c6a3e462 admin admin] PATH_INFO: `/v3/projects/77f68210321d4532ba50492ddaeb4142/users/e66ca45068ad4bbd8cb10c348d4c1ddf/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:35.952618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fb9f4-9274-4d5c-9249-11f3c6a3e462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f68210321d4532ba50492ddaeb4142, user_id=e66ca45068ad4bbd8cb10c348d4c1ddf, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:35.968969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fb9f4-9274-4d5c-9249-11f3c6a3e462 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:36.016917 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 821/1643] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:35 2022] PUT /identity/v3/projects/77f68210321d4532ba50492ddaeb4142/users/e66ca45068ad4bbd8cb10c348d4c1ddf/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:36.032592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fb9f4-9274-4d5c-9249-11f3c6a3e462 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:36.048724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89e31-2ac4-4114-8e53-58344b54acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:36.049836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89e31-2ac4-4114-8e53-58344b54acfc admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:36.050201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89e31-2ac4-4114-8e53-58344b54acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:36.050537 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89e31-2ac4-4114-8e53-58344b54acfc admin admin] PATH_INFO: `/v3/projects/4279de053f9341e0b6a913f47dc7d984/users/fdc7b2e1e26046f18618b1dc116ac3d2/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:36.096353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89e31-2ac4-4114-8e53-58344b54acfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4279de053f9341e0b6a913f47dc7d984, user_id=fdc7b2e1e26046f18618b1dc116ac3d2, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:36.100050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89e31-2ac4-4114-8e53-58344b54acfc admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:36.136927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 823/1644] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:35 2022] PUT /identity/v3/projects/4279de053f9341e0b6a913f47dc7d984/users/fdc7b2e1e26046f18618b1dc116ac3d2/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:36.136927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89e31-2ac4-4114-8e53-58344b54acfc admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:36.175421 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fb9f4-9274-4d5c-9249-11f3c6a3e462 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:36.260346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89e31-2ac4-4114-8e53-58344b54acfc admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:36.265570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410ff18-5f61-40fd-b6a4-09038c6fbaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:36.266673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410ff18-5f61-40fd-b6a4-09038c6fbaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:36.266673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410ff18-5f61-40fd-b6a4-09038c6fbaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:36.267005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410ff18-5f61-40fd-b6a4-09038c6fbaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:36.267592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410ff18-5f61-40fd-b6a4-09038c6fbaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:36.269478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410ff18-5f61-40fd-b6a4-09038c6fbaf1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:36.293408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 824/1645] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:36.295947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19df35-c2f6-47c9-99e0-fdbe59f2c4ac None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:36.296447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19df35-c2f6-47c9-99e0-fdbe59f2c4ac None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:36.296867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19df35-c2f6-47c9-99e0-fdbe59f2c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:36.328660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf45cf-a059-4484-9a23-5e461e45b5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:36.337396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf45cf-a059-4484-9a23-5e461e45b5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:36.338054 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf45cf-a059-4484-9a23-5e461e45b5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:36.338426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf45cf-a059-4484-9a23-5e461e45b5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:36.350781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-2a19df35-c2f6-47c9-99e0-fdbe59f2c4ac None None] MFA Rules not processed for user `e66ca45068ad4bbd8cb10c348d4c1ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:36.353657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2a19df35-c2f6-47c9-99e0-fdbe59f2c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:36.506378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf45cf-a059-4484-9a23-5e461e45b5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:36.509744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf45cf-a059-4484-9a23-5e461e45b5d7 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:36.542701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 822/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:36.547247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf45cf-a059-4484-9a23-5e461e45b5d7 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:36.576339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 825/1647] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:36.579713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19df35-c2f6-47c9-99e0-fdbe59f2c4ac None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:36.591638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf45cf-a059-4484-9a23-5e461e45b5d7 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:36.634128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d95f66-d3ea-4c12-8f5b-eda8b0e24d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:36.641433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d95f66-d3ea-4c12-8f5b-eda8b0e24d6c admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:36.641969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d95f66-d3ea-4c12-8f5b-eda8b0e24d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:36.642453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d95f66-d3ea-4c12-8f5b-eda8b0e24d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:36.643879 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d95f66-d3ea-4c12-8f5b-eda8b0e24d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:36.648134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19df35-c2f6-47c9-99e0-fdbe59f2c4ac None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:36.659755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d95f66-d3ea-4c12-8f5b-eda8b0e24d6c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:36.672834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661d15e-37c4-4e3f-98a5-44aa2650af2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:36.675614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661d15e-37c4-4e3f-98a5-44aa2650af2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:36.679328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661d15e-37c4-4e3f-98a5-44aa2650af2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:36.679943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661d15e-37c4-4e3f-98a5-44aa2650af2c admin admin] PATH_INFO: `/v3/projects/ce3d042d53ed489aacc2e9f757db70d1/users/f3e00b19d3ad44b5a1f88129b862bc46/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:36.695812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661d15e-37c4-4e3f-98a5-44aa2650af2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3d042d53ed489aacc2e9f757db70d1, user_id=f3e00b19d3ad44b5a1f88129b862bc46, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:36.699526 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661d15e-37c4-4e3f-98a5-44aa2650af2c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:36.724047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 826/1648] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:36 2022] PUT /identity/v3/projects/ce3d042d53ed489aacc2e9f757db70d1/users/f3e00b19d3ad44b5a1f88129b862bc46/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:36.726673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661d15e-37c4-4e3f-98a5-44aa2650af2c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:36.728693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 823/1649] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:36.735625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d95f66-d3ea-4c12-8f5b-eda8b0e24d6c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:36.764872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d95f66-d3ea-4c12-8f5b-eda8b0e24d6c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:36.907592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661d15e-37c4-4e3f-98a5-44aa2650af2c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:36.918616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b08925-41fc-4e9c-b328-183421e9bcac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:36.919573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08925-41fc-4e9c-b328-183421e9bcac service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:36.920291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08925-41fc-4e9c-b328-183421e9bcac service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:36.920733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b08925-41fc-4e9c-b328-183421e9bcac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:36.992193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:36.994568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:36.994568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:36.994960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] PATH_INFO: `/v3/users/e35d1daac2664b94af237e40db21d3a3` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:36.998101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35d1daac2664b94af237e40db21d3a3)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:37.000100 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: WARNING py.warnings [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:53:37.000100 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: warnings.warn(msg) Mar 22 19:53:37.000100 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: Mar 22 19:53:37.003409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:37.102518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b08925-41fc-4e9c-b328-183421e9bcac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:37.105660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b08925-41fc-4e9c-b328-183421e9bcac service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:37.149310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 827/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:37.151786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ccfa-9def-442f-8b75-772db47c57b8 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:37.152341 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ccfa-9def-442f-8b75-772db47c57b8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:37.152823 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ccfa-9def-442f-8b75-772db47c57b8 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:37.162857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 828/1651] 10.222.0.49 () {54 vars in 912 bytes} [Tue Mar 22 19:53:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:53:37.165348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9634b-ae7a-4bc8-b09e-b3bb5dd8c76d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:37.165789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9634b-ae7a-4bc8-b09e-b3bb5dd8c76d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:37.166277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9634b-ae7a-4bc8-b09e-b3bb5dd8c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:37.178658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35d1daac2664b94af237e40db21d3a3'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:37.179736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35d1daac2664b94af237e40db21d3a3'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:37.180502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35d1daac2664b94af237e40db21d3a3'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:37.195803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35d1daac2664b94af237e40db21d3a3'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:37.247587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35d1daac2664b94af237e40db21d3a3'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:37.271384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-bac9634b-ae7a-4bc8-b09e-b3bb5dd8c76d None None] MFA Rules not processed for user `f3e00b19d3ad44b5a1f88129b862bc46`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:37.273510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-bac9634b-ae7a-4bc8-b09e-b3bb5dd8c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:37.369801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 824/1652] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:53:36 2022] DELETE /identity/v3/users/e35d1daac2664b94af237e40db21d3a3 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:37.371199 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:37.373254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:37.551880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 829/1653] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:37.551880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7253cff-ecc4-48ee-b673-2d68964e4aba None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:37.551880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7253cff-ecc4-48ee-b673-2d68964e4aba None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:37.551880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7253cff-ecc4-48ee-b673-2d68964e4aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:37.580283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16137aa-39fb-4eb7-8b5a-53201613a953 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:37.586262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938da1b4-7e97-4851-94b1-6914aac41999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:37.588157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938da1b4-7e97-4851-94b1-6914aac41999 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:37.588683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938da1b4-7e97-4851-94b1-6914aac41999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:37.589062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938da1b4-7e97-4851-94b1-6914aac41999 admin admin] PATH_INFO: `/v3/projects/4279de053f9341e0b6a913f47dc7d984/users/fdc7b2e1e26046f18618b1dc116ac3d2/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:37.592301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938da1b4-7e97-4851-94b1-6914aac41999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4279de053f9341e0b6a913f47dc7d984, user_id=fdc7b2e1e26046f18618b1dc116ac3d2, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:37.596481 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938da1b4-7e97-4851-94b1-6914aac41999 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:37.607521 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a7253cff-ecc4-48ee-b673-2d68964e4aba None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:37.609677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a7253cff-ecc4-48ee-b673-2d68964e4aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:37.610873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 825/1654] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:37 2022] PUT /identity/v3/projects/4279de053f9341e0b6a913f47dc7d984/users/fdc7b2e1e26046f18618b1dc116ac3d2/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:37.612880 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd904b5-25f7-43fd-a114-c251445bd3e3 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:37.613297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd904b5-25f7-43fd-a114-c251445bd3e3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:37.613685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd904b5-25f7-43fd-a114-c251445bd3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:37.638106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3dd904b5-25f7-43fd-a114-c251445bd3e3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:37.643952 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3dd904b5-25f7-43fd-a114-c251445bd3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:37.819821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 830/1655] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:37.825642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7253cff-ecc4-48ee-b673-2d68964e4aba None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:37.839696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a7253cff-ecc4-48ee-b673-2d68964e4aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:37.899433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 826/1656] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:37.901446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd904b5-25f7-43fd-a114-c251445bd3e3 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:37.906578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3dd904b5-25f7-43fd-a114-c251445bd3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:37.919022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7253cff-ecc4-48ee-b673-2d68964e4aba None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:37.924101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868258a-44aa-4953-96f6-ab2e7fd827c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:37.924875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868258a-44aa-4953-96f6-ab2e7fd827c3 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:37.925217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868258a-44aa-4953-96f6-ab2e7fd827c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:37.925563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868258a-44aa-4953-96f6-ab2e7fd827c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:37.927852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3868258a-44aa-4953-96f6-ab2e7fd827c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:37.933312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd904b5-25f7-43fd-a114-c251445bd3e3 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:37.947641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655204d-5d5a-4d80-9bdb-246bca0a5724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:37.948497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655204d-5d5a-4d80-9bdb-246bca0a5724 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:37.948654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655204d-5d5a-4d80-9bdb-246bca0a5724 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:37.948916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655204d-5d5a-4d80-9bdb-246bca0a5724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:38.064789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868258a-44aa-4953-96f6-ab2e7fd827c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:38.068552 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868258a-44aa-4953-96f6-ab2e7fd827c3 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:38.092185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 831/1657] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:38.095318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e88274-6024-4363-a380-5529c5ceda06 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:38.095739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e88274-6024-4363-a380-5529c5ceda06 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:38.095932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e88274-6024-4363-a380-5529c5ceda06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:38.101068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655204d-5d5a-4d80-9bdb-246bca0a5724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:38.104859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655204d-5d5a-4d80-9bdb-246bca0a5724 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:38.142205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 827/1658] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:37 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:38.143253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655204d-5d5a-4d80-9bdb-246bca0a5724 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:38.149015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7655204d-5d5a-4d80-9bdb-246bca0a5724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:38.197963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-88e88274-6024-4363-a380-5529c5ceda06 None None] MFA Rules not processed for user `fdc7b2e1e26046f18618b1dc116ac3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:38.201115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-88e88274-6024-4363-a380-5529c5ceda06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:38.449299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 832/1659] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:38.454683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e88274-6024-4363-a380-5529c5ceda06 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:38.462518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-88e88274-6024-4363-a380-5529c5ceda06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:38.481690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655204d-5d5a-4d80-9bdb-246bca0a5724 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:38.499641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ffb5b-654c-4ba4-bb38-0622ca44995a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:38.500752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ffb5b-654c-4ba4-bb38-0622ca44995a service glance] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:38.501233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ffb5b-654c-4ba4-bb38-0622ca44995a service glance] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:38.501697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ffb5b-654c-4ba4-bb38-0622ca44995a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:38.563749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ffb5b-654c-4ba4-bb38-0622ca44995a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:38.568727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ffb5b-654c-4ba4-bb38-0622ca44995a service glance] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:38.643792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 828/1660] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:38.669013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ffb5b-654c-4ba4-bb38-0622ca44995a service glance] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:38.692108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e88274-6024-4363-a380-5529c5ceda06 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:38.698847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b319a8-a634-4414-8346-107b8586327a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:38.699815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b319a8-a634-4414-8346-107b8586327a service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:38.700015 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b319a8-a634-4414-8346-107b8586327a service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:38.700382 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b319a8-a634-4414-8346-107b8586327a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:38.739322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b319a8-a634-4414-8346-107b8586327a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:38.748113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b319a8-a634-4414-8346-107b8586327a service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:38.750332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ffb5b-654c-4ba4-bb38-0622ca44995a service glance] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:38.756430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17742838-38c6-4bf0-bfa2-79bb8509db01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:38.757554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17742838-38c6-4bf0-bfa2-79bb8509db01 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:38.758209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17742838-38c6-4bf0-bfa2-79bb8509db01 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:38.758715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17742838-38c6-4bf0-bfa2-79bb8509db01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:38.770051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17742838-38c6-4bf0-bfa2-79bb8509db01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:38.771989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17742838-38c6-4bf0-bfa2-79bb8509db01 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:38.785598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 829/1661] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:38.871417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 833/1662] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:38.906674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17742838-38c6-4bf0-bfa2-79bb8509db01 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:38.908757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-17742838-38c6-4bf0-bfa2-79bb8509db01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:38.967607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17742838-38c6-4bf0-bfa2-79bb8509db01 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:38.982757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:38.985160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:38.986553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:38.987374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] PATH_INFO: `/v3/users/cc6cb9a3747b4fadacbf3ad4e89a8ef2` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:38.990505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6cb9a3747b4fadacbf3ad4e89a8ef2)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:38.997141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:39.032670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b319a8-a634-4414-8346-107b8586327a service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:39.056833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b319a8-a634-4414-8346-107b8586327a service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:39.075685 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:39.077333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:39.078236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:39.078968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:39.083988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:39.127619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6cb9a3747b4fadacbf3ad4e89a8ef2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:39.131515 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6cb9a3747b4fadacbf3ad4e89a8ef2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:39.134482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6cb9a3747b4fadacbf3ad4e89a8ef2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:39.166866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6cb9a3747b4fadacbf3ad4e89a8ef2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:39.179814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7f1394b0-f1bf-46d7-9daf-cb92a2e031eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6cb9a3747b4fadacbf3ad4e89a8ef2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:39.228099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 830/1663] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:53:38 2022] DELETE /identity/v3/users/cc6cb9a3747b4fadacbf3ad4e89a8ef2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:53:39.230485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:39.233800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:39.234661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a67335-345f-44a0-b2ca-3399b4bd6b3c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:39.234962 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a67335-345f-44a0-b2ca-3399b4bd6b3c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:39.235289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a67335-345f-44a0-b2ca-3399b4bd6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:39.255306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 834/1664] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:39.287304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d1a67335-345f-44a0-b2ca-3399b4bd6b3c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:39.290091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d1a67335-345f-44a0-b2ca-3399b4bd6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:39.495162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 831/1665] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:39.533301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:39.536157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:39.579375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b88e4-3b7e-43b1-a865-7ce9a6952f46 service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:39.807272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08fa19-13e7-429f-9ba9-fd54f1c654fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:39.808720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08fa19-13e7-429f-9ba9-fd54f1c654fb service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:39.809219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08fa19-13e7-429f-9ba9-fd54f1c654fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:39.809693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08fa19-13e7-429f-9ba9-fd54f1c654fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:39.828165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08fa19-13e7-429f-9ba9-fd54f1c654fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:39.847162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08fa19-13e7-429f-9ba9-fd54f1c654fb service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:39.871046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 835/1666] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:40.093702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110ec36-bfe2-4d13-adb4-47d791932aec None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:40.094016 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110ec36-bfe2-4d13-adb4-47d791932aec None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:40.094316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110ec36-bfe2-4d13-adb4-47d791932aec None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:40.096514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 832/1667] 10.222.0.49 () {54 vars in 912 bytes} [Tue Mar 22 19:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:53:40.108357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732da6f7-98ef-4e1f-86ee-1782b8cbc575 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:40.109227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732da6f7-98ef-4e1f-86ee-1782b8cbc575 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:40.109682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732da6f7-98ef-4e1f-86ee-1782b8cbc575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:40.253290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-732da6f7-98ef-4e1f-86ee-1782b8cbc575 None None] MFA Rules not processed for user `c2e837368cdc4df29d945a4c8e662a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:40.256965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-732da6f7-98ef-4e1f-86ee-1782b8cbc575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:40.290590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 836/1668] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 19:53:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:53:40.426988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110ec36-bfe2-4d13-adb4-47d791932aec None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:40.429475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0110ec36-bfe2-4d13-adb4-47d791932aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:40.467142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110ec36-bfe2-4d13-adb4-47d791932aec None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:40.480877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e5da4-587f-4c28-ade1-ad9a133f9b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:40.482089 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e5da4-587f-4c28-ade1-ad9a133f9b65 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:40.482582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e5da4-587f-4c28-ade1-ad9a133f9b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:40.483019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e5da4-587f-4c28-ade1-ad9a133f9b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:40.495180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e5da4-587f-4c28-ade1-ad9a133f9b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:40.497287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e5da4-587f-4c28-ade1-ad9a133f9b65 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:40.538500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 833/1669] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:41.403724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732da6f7-98ef-4e1f-86ee-1782b8cbc575 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:41.410174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-732da6f7-98ef-4e1f-86ee-1782b8cbc575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:41.479238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732da6f7-98ef-4e1f-86ee-1782b8cbc575 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:41.524086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:41.530902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:41.537668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:41.542055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] PATH_INFO: `/v3/projects/ccb76eb4a9914e76b9035ee16d5c8075` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:41.551918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb76eb4a9914e76b9035ee16d5c8075)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:41.560951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: WARNING py.warnings [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 22 19:53:41.560951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: warnings.warn(msg) Mar 22 19:53:41.560951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: Mar 22 19:53:41.571297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:41.927149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb76eb4a9914e76b9035ee16d5c8075', 'request_id': 'req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:41.972731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb76eb4a9914e76b9035ee16d5c8075', 'request_id': 'req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:42.008273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb76eb4a9914e76b9035ee16d5c8075', 'request_id': 'req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:42.091286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] The token cache is being invalidate because project ccb76eb4a9914e76b9035ee16d5c8075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:53:42.092331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:42.094151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:42.105760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 837/1670] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:53:41 2022] DELETE /identity/v3/projects/ccb76eb4a9914e76b9035ee16d5c8075 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:42.111457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e5da4-587f-4c28-ade1-ad9a133f9b65 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:42.166576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e5da4-587f-4c28-ade1-ad9a133f9b65 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:42.207759 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:42.211014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:42.492279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:42.493690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:42.500986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:42.501570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] PATH_INFO: `/v3/users/1698cabe93cf42a4839b446c4fa64ab4` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:42.507966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1698cabe93cf42a4839b446c4fa64ab4)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:42.511899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:42.591275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e4ef3-7bf2-4ae9-9ec4-b6b944084d81 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:42.624841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:42.626223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:42.626739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:42.627238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] PATH_INFO: `/v3/projects/594ac98f148e4aa5b1a84afc8bbd39dc` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:42.657135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] RBAC: Authorizing `identity:delete_project(project_id=594ac98f148e4aa5b1a84afc8bbd39dc)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:42.660905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:42.834486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1698cabe93cf42a4839b446c4fa64ab4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:42.839272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1698cabe93cf42a4839b446c4fa64ab4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:42.845797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1698cabe93cf42a4839b446c4fa64ab4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:42.905816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1698cabe93cf42a4839b446c4fa64ab4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:42.959932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1698cabe93cf42a4839b446c4fa64ab4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.038667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594ac98f148e4aa5b1a84afc8bbd39dc', 'request_id': 'req-83f8f553-4770-4628-95c6-a960c97338da'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.083669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594ac98f148e4aa5b1a84afc8bbd39dc', 'request_id': 'req-83f8f553-4770-4628-95c6-a960c97338da'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.105251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 834/1671] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:53:42 2022] DELETE /identity/v3/users/1698cabe93cf42a4839b446c4fa64ab4 => generated 0 bytes in 990 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:43.114786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594ac98f148e4aa5b1a84afc8bbd39dc', 'request_id': 'req-83f8f553-4770-4628-95c6-a960c97338da'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.178651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] The token cache is being invalidate because project 594ac98f148e4aa5b1a84afc8bbd39dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:53:43.181676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.185519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-83f8f553-4770-4628-95c6-a960c97338da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.206263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:43.209460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:43.210883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 838/1672] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:53:42 2022] DELETE /identity/v3/projects/594ac98f148e4aa5b1a84afc8bbd39dc => generated 0 bytes in 993 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:43.525137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b718c52-d7c1-43e1-8fce-c39a4c23420b None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:43.526230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b718c52-d7c1-43e1-8fce-c39a4c23420b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:43.527431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b718c52-d7c1-43e1-8fce-c39a4c23420b None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:43.533976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 839/1673] 10.222.0.49 () {54 vars in 960 bytes} [Tue Mar 22 19:53:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:53:43.543730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7355b74-cef9-4783-8e3e-d60ceeecbad0 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:43.544978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7355b74-cef9-4783-8e3e-d60ceeecbad0 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:43.546595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7355b74-cef9-4783-8e3e-d60ceeecbad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:43.574899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999144ef-daff-47ff-826b-834e6bfe9630 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:43.596464 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:43.598997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:43.599513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:43.599996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] PATH_INFO: `/v3/users/f3e00b19d3ad44b5a1f88129b862bc46` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:43.605293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e00b19d3ad44b5a1f88129b862bc46)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:43.651751 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:43.690324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c7355b74-cef9-4783-8e3e-d60ceeecbad0 None None] MFA Rules not processed for user `eed3ec40f28c4bc990d8f56466889aff`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:43.698101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c7355b74-cef9-4783-8e3e-d60ceeecbad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:43.807557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e00b19d3ad44b5a1f88129b862bc46'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.808514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e00b19d3ad44b5a1f88129b862bc46'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.809606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e00b19d3ad44b5a1f88129b862bc46'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.829794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e00b19d3ad44b5a1f88129b862bc46'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.847365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-983f7bc9-9aaa-4a02-97fc-3a0ac5a81230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e00b19d3ad44b5a1f88129b862bc46'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:43.883206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 835/1674] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:53:43 2022] DELETE /identity/v3/users/f3e00b19d3ad44b5a1f88129b862bc46 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:43.936908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ccb2f-8c5d-498a-a55d-56e50ee9956c None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:43.937199 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ccb2f-8c5d-498a-a55d-56e50ee9956c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:43.937486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ccb2f-8c5d-498a-a55d-56e50ee9956c None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:43.940293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 836/1675] 10.222.0.49 () {54 vars in 959 bytes} [Tue Mar 22 19:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:53:43.947111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b872cd-8a59-4b18-9dad-581b6c242b3c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:43.947764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b872cd-8a59-4b18-9dad-581b6c242b3c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:43.948183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b872cd-8a59-4b18-9dad-581b6c242b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:43.994535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-63b872cd-8a59-4b18-9dad-581b6c242b3c None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:43.996384 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-63b872cd-8a59-4b18-9dad-581b6c242b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:44.128677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 837/1676] 10.222.0.49 () {58 vars in 1056 bytes} [Tue Mar 22 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:53:44.130377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d92fc-2e16-461d-83aa-25b2a270274c None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:44.131004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d92fc-2e16-461d-83aa-25b2a270274c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:44.137699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d92fc-2e16-461d-83aa-25b2a270274c None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:44.149090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 838/1677] 10.222.0.49 () {54 vars in 912 bytes} [Tue Mar 22 19:53:44 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:53:44.150703 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0b03f-92f4-4362-85ce-c21d4341f312 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:44.150997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0b03f-92f4-4362-85ce-c21d4341f312 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:44.151285 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0b03f-92f4-4362-85ce-c21d4341f312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:44.207180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-19c0b03f-92f4-4362-85ce-c21d4341f312 None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:44.211386 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-19c0b03f-92f4-4362-85ce-c21d4341f312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:44.220697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 840/1678] 10.222.0.49 () {58 vars in 1057 bytes} [Tue Mar 22 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 681 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:44.241280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7355b74-cef9-4783-8e3e-d60ceeecbad0 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:44.265165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7355b74-cef9-4783-8e3e-d60ceeecbad0 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:44.296766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 839/1679] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 19:53:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:44.441418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0b03f-92f4-4362-85ce-c21d4341f312 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:44.452652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-19c0b03f-92f4-4362-85ce-c21d4341f312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:44.549154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:44.550304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:44.550793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:44.551279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:44.562897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:44.620907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:44.621497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0b03f-92f4-4362-85ce-c21d4341f312 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:44.626292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:44.634737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7078734-5a61-4514-b11c-4b281604cac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:44.635771 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7078734-5a61-4514-b11c-4b281604cac2 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:44.636090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7078734-5a61-4514-b11c-4b281604cac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:44.636514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7078734-5a61-4514-b11c-4b281604cac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:44.667325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 841/1680] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:44.685529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7078734-5a61-4514-b11c-4b281604cac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:44.692633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7078734-5a61-4514-b11c-4b281604cac2 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:44.750371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 840/1681] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:45.568246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:45.572944 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:45.786028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7078734-5a61-4514-b11c-4b281604cac2 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:45.789555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b7078734-5a61-4514-b11c-4b281604cac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:45.846518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba95e1-2506-4c98-be56-daf65ec9a704 service placement] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:45.860396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:45.864354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:45.866628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:45.868333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] PATH_INFO: `/v3/projects/07399cd228ea45cc8e378300c1ef2e43` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:45.872108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07399cd228ea45cc8e378300c1ef2e43)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:45.878534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:46.071135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07399cd228ea45cc8e378300c1ef2e43', 'request_id': 'req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.082431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7078734-5a61-4514-b11c-4b281604cac2 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:46.086524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07399cd228ea45cc8e378300c1ef2e43', 'request_id': 'req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.109004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07399cd228ea45cc8e378300c1ef2e43', 'request_id': 'req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.212887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] The token cache is being invalidate because project 07399cd228ea45cc8e378300c1ef2e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:53:46.213406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.230491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3b0ba400-9676-4aa9-a6cf-19cb31f799a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.243735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 842/1682] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:53:45 2022] DELETE /identity/v3/projects/07399cd228ea45cc8e378300c1ef2e43 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:46.254044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa21b-a4c6-4305-8870-78cacd415f86 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:46.258328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa21b-a4c6-4305-8870-78cacd415f86 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:46.259158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa21b-a4c6-4305-8870-78cacd415f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:46.295136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:46.296978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:46.299726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:46.300420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] PATH_INFO: `/v3/projects/ce3d042d53ed489aacc2e9f757db70d1` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:46.310909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3d042d53ed489aacc2e9f757db70d1)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:46.323317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:46.357241 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-3e9fa21b-a4c6-4305-8870-78cacd415f86 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:46.359496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3e9fa21b-a4c6-4305-8870-78cacd415f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:46.378714 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 843/1683] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:53:46.401791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e26b22-5cba-4efa-afc6-4fbf707dd258 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:46.406726 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e26b22-5cba-4efa-afc6-4fbf707dd258 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:46.409095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e26b22-5cba-4efa-afc6-4fbf707dd258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:46.469283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-16e26b22-5cba-4efa-afc6-4fbf707dd258 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:46.475770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-16e26b22-5cba-4efa-afc6-4fbf707dd258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:46.517536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 844/1684] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:46.519306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e26b22-5cba-4efa-afc6-4fbf707dd258 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:46.561258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e26b22-5cba-4efa-afc6-4fbf707dd258 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:46.644620 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3d042d53ed489aacc2e9f757db70d1', 'request_id': 'req-60720ba1-fb57-4210-945c-6fd7776383d5'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.671541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3d042d53ed489aacc2e9f757db70d1', 'request_id': 'req-60720ba1-fb57-4210-945c-6fd7776383d5'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.692519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3d042d53ed489aacc2e9f757db70d1', 'request_id': 'req-60720ba1-fb57-4210-945c-6fd7776383d5'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.751492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] The token cache is being invalidate because project ce3d042d53ed489aacc2e9f757db70d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:53:46.752301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.757006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-60720ba1-fb57-4210-945c-6fd7776383d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:53:46.761972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 841/1685] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:53:45 2022] DELETE /identity/v3/projects/ce3d042d53ed489aacc2e9f757db70d1 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:46.771404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e071bd-0075-4596-9ba0-c0499331fc42 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:46.772187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e071bd-0075-4596-9ba0-c0499331fc42 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:46.772866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e071bd-0075-4596-9ba0-c0499331fc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:46.808790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:46.810130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:46.810557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:46.811062 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:46.812643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:46.813001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:46.831747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-61e071bd-0075-4596-9ba0-c0499331fc42 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:46.835550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:46.837741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-61e071bd-0075-4596-9ba0-c0499331fc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:46.860487 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 842/1686] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:46.873151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180af6f-84f8-438c-ab0e-a7030e6a30f5 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:46.873618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180af6f-84f8-438c-ab0e-a7030e6a30f5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:46.874338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180af6f-84f8-438c-ab0e-a7030e6a30f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:46.909079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 845/1687] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:46.910610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:46.920632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:46.945615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1180af6f-84f8-438c-ab0e-a7030e6a30f5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:46.951507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1180af6f-84f8-438c-ab0e-a7030e6a30f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:46.959139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccca857-66b5-4476-8c0c-15360f806582 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:46.982627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21887a-e1c0-4bff-945c-8b4e7f6ced8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:46.983983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21887a-e1c0-4bff-945c-8b4e7f6ced8b admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:46.984460 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21887a-e1c0-4bff-945c-8b4e7f6ced8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:46.984927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21887a-e1c0-4bff-945c-8b4e7f6ced8b admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:46.994458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21887a-e1c0-4bff-945c-8b4e7f6ced8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:46.997593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 843/1688] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:53:46.998011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21887a-e1c0-4bff-945c-8b4e7f6ced8b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:47.002570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180af6f-84f8-438c-ab0e-a7030e6a30f5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:47.067212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180af6f-84f8-438c-ab0e-a7030e6a30f5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:47.081966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3bd04-a2e3-42bd-a2e8-557d6ea55d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:47.083578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3bd04-a2e3-42bd-a2e8-557d6ea55d9a admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:47.084326 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3bd04-a2e3-42bd-a2e8-557d6ea55d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:47.085483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3bd04-a2e3-42bd-a2e8-557d6ea55d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:47.087290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3bd04-a2e3-42bd-a2e8-557d6ea55d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:53:47.089120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3bd04-a2e3-42bd-a2e8-557d6ea55d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:47.092892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3bd04-a2e3-42bd-a2e8-557d6ea55d9a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:47.111257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 846/1689] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:46 2022] POST /identity/v3/projects => generated 393 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:47.115683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21887a-e1c0-4bff-945c-8b4e7f6ced8b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:47.123724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 844/1690] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:53:47.125473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3bd04-a2e3-42bd-a2e8-557d6ea55d9a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:47.168770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3bd04-a2e3-42bd-a2e8-557d6ea55d9a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:47.347262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45796e5c-90f4-42d7-bc12-b0fd443483ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:47.349198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45796e5c-90f4-42d7-bc12-b0fd443483ba admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:47.349974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45796e5c-90f4-42d7-bc12-b0fd443483ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:47.350713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45796e5c-90f4-42d7-bc12-b0fd443483ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:47.352479 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45796e5c-90f4-42d7-bc12-b0fd443483ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:47.362826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45796e5c-90f4-42d7-bc12-b0fd443483ba admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:47.366518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21887a-e1c0-4bff-945c-8b4e7f6ced8b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:47.383614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024fdae-d08c-4cc0-8e06-beeb54d9ea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:47.385966 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024fdae-d08c-4cc0-8e06-beeb54d9ea38 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:47.387415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024fdae-d08c-4cc0-8e06-beeb54d9ea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:47.388292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024fdae-d08c-4cc0-8e06-beeb54d9ea38 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:47.389876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024fdae-d08c-4cc0-8e06-beeb54d9ea38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:47.393866 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024fdae-d08c-4cc0-8e06-beeb54d9ea38 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:47.448681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 847/1691] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:47 2022] POST /identity/v3/users => generated 297 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:53:47.448681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024fdae-d08c-4cc0-8e06-beeb54d9ea38 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:47.463143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 845/1692] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:47 2022] POST /identity/v3/projects => generated 385 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:47.475980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45796e5c-90f4-42d7-bc12-b0fd443483ba admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:47.493628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024fdae-d08c-4cc0-8e06-beeb54d9ea38 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:47.715206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45796e5c-90f4-42d7-bc12-b0fd443483ba admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:47.717073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaac46-063d-43f6-a125-0c9bab404154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:47.719910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaac46-063d-43f6-a125-0c9bab404154 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:47.720633 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaac46-063d-43f6-a125-0c9bab404154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:47.722366 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaac46-063d-43f6-a125-0c9bab404154 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:47.724004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaac46-063d-43f6-a125-0c9bab404154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:47.726831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaac46-063d-43f6-a125-0c9bab404154 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:47.753143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691c65-88a5-4458-888d-d762b698b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:47.755534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 848/1693] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:47.756565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691c65-88a5-4458-888d-d762b698b14a admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:47.757057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691c65-88a5-4458-888d-d762b698b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:47.757644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691c65-88a5-4458-888d-d762b698b14a admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:47.759094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21691c65-88a5-4458-888d-d762b698b14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:47.761838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaac46-063d-43f6-a125-0c9bab404154 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:47.770482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21691c65-88a5-4458-888d-d762b698b14a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:47.787207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaac46-063d-43f6-a125-0c9bab404154 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:47.808667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa4ea8-e135-4d80-a60a-a07d5db5361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:47.810201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa4ea8-e135-4d80-a60a-a07d5db5361a admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:47.811033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa4ea8-e135-4d80-a60a-a07d5db5361a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:47.811033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa4ea8-e135-4d80-a60a-a07d5db5361a admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:47.812743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa4ea8-e135-4d80-a60a-a07d5db5361a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:47.823980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa4ea8-e135-4d80-a60a-a07d5db5361a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:47.829309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 846/1694] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:47 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:47.832851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691c65-88a5-4458-888d-d762b698b14a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:47.864874 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 849/1695] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:47.866947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691c65-88a5-4458-888d-d762b698b14a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:47.870423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa4ea8-e135-4d80-a60a-a07d5db5361a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:47.905188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599874d-e43c-415b-86b2-87d1d8fb9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:47.906852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599874d-e43c-415b-86b2-87d1d8fb9764 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:47.907342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599874d-e43c-415b-86b2-87d1d8fb9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:47.907813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599874d-e43c-415b-86b2-87d1d8fb9764 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:47.916846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599874d-e43c-415b-86b2-87d1d8fb9764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:47.938243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599874d-e43c-415b-86b2-87d1d8fb9764 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:47.946219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa4ea8-e135-4d80-a60a-a07d5db5361a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:47.972359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 847/1696] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:47.972599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee42e-3041-48e6-a1cf-97423af7c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:47.974757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee42e-3041-48e6-a1cf-97423af7c1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:47.976744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2b017-8ffa-45ee-b060-cf86c00ab6fc None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:47.977284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2b017-8ffa-45ee-b060-cf86c00ab6fc None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:47.977494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2b017-8ffa-45ee-b060-cf86c00ab6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:47.977796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee42e-3041-48e6-a1cf-97423af7c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:47.982331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee42e-3041-48e6-a1cf-97423af7c1ec admin admin] PATH_INFO: `/v3/projects/6139db26560748ff8b550ca173314bc2/users/c99d076cfd2443bfb33b5b3d9f2906d7/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:48.055994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-fbc2b017-8ffa-45ee-b060-cf86c00ab6fc None None] MFA Rules not processed for user `3763d1d3f1cd46058e1979062d084de5`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:48.057489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee42e-3041-48e6-a1cf-97423af7c1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6139db26560748ff8b550ca173314bc2, user_id=c99d076cfd2443bfb33b5b3d9f2906d7, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:48.060633 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee42e-3041-48e6-a1cf-97423af7c1ec admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:48.062263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-fbc2b017-8ffa-45ee-b060-cf86c00ab6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:48.101990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 850/1697] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:47 2022] PUT /identity/v3/projects/6139db26560748ff8b550ca173314bc2/users/c99d076cfd2443bfb33b5b3d9f2906d7/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:53:48.101990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee42e-3041-48e6-a1cf-97423af7c1ec admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:48.216587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee42e-3041-48e6-a1cf-97423af7c1ec admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:48.237371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410c6ad-7b9e-4dc8-b2ed-8ba939d70fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:48.238210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410c6ad-7b9e-4dc8-b2ed-8ba939d70fdb admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:48.238344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410c6ad-7b9e-4dc8-b2ed-8ba939d70fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:48.238628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410c6ad-7b9e-4dc8-b2ed-8ba939d70fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:48.240999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410c6ad-7b9e-4dc8-b2ed-8ba939d70fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:48.242817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410c6ad-7b9e-4dc8-b2ed-8ba939d70fdb admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:48.290385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 851/1698] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:48.290385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e37b3-fefe-42ba-8fd4-bad28e05fe7a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:48.290385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e37b3-fefe-42ba-8fd4-bad28e05fe7a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:48.290385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e37b3-fefe-42ba-8fd4-bad28e05fe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:48.320522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 848/1699] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:48.327142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2b017-8ffa-45ee-b060-cf86c00ab6fc None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:48.362389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2b017-8ffa-45ee-b060-cf86c00ab6fc None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:48.390256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24af9-2efa-4121-81b7-0e9e3091ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:48.391215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24af9-2efa-4121-81b7-0e9e3091ca8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:48.391499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24af9-2efa-4121-81b7-0e9e3091ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:48.391778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24af9-2efa-4121-81b7-0e9e3091ca8d admin admin] PATH_INFO: `/v3/projects/766682daffb246a090e32e8f4a8bad2b/users/f8b079c262bf4a659edc9da4d3d0df23/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:48.437902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-2a5e37b3-fefe-42ba-8fd4-bad28e05fe7a None None] MFA Rules not processed for user `c99d076cfd2443bfb33b5b3d9f2906d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:48.439504 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2a5e37b3-fefe-42ba-8fd4-bad28e05fe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:48.443671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef24af9-2efa-4121-81b7-0e9e3091ca8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=766682daffb246a090e32e8f4a8bad2b, user_id=f8b079c262bf4a659edc9da4d3d0df23, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:48.446455 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef24af9-2efa-4121-81b7-0e9e3091ca8d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:48.493720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 849/1700] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:48 2022] PUT /identity/v3/projects/766682daffb246a090e32e8f4a8bad2b/users/f8b079c262bf4a659edc9da4d3d0df23/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:48.494993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24af9-2efa-4121-81b7-0e9e3091ca8d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:48.505535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2ef24af9-2efa-4121-81b7-0e9e3091ca8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:48.690557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24af9-2efa-4121-81b7-0e9e3091ca8d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:48.709840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 852/1701] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:48.715281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daac30-6103-41fc-a922-8f8aa148c7ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:48.716122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daac30-6103-41fc-a922-8f8aa148c7ee service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:48.716482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daac30-6103-41fc-a922-8f8aa148c7ee service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:48.716766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daac30-6103-41fc-a922-8f8aa148c7ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:48.717163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5a38-0004-4810-baa8-289e36f6b304 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:48.723248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5a38-0004-4810-baa8-289e36f6b304 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:48.723926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5a38-0004-4810-baa8-289e36f6b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:48.824750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-632f5a38-0004-4810-baa8-289e36f6b304 None None] MFA Rules not processed for user `f8b079c262bf4a659edc9da4d3d0df23`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:48.826983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-632f5a38-0004-4810-baa8-289e36f6b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:48.860091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daac30-6103-41fc-a922-8f8aa148c7ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:48.861777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daac30-6103-41fc-a922-8f8aa148c7ee service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:48.896094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 850/1702] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:48.897126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daac30-6103-41fc-a922-8f8aa148c7ee service nova] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.036337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daac30-6103-41fc-a922-8f8aa148c7ee service nova] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:49.058935 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5235b6-2944-408b-82d3-5fa9b5d51aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:49.059890 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5235b6-2944-408b-82d3-5fa9b5d51aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.060012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5235b6-2944-408b-82d3-5fa9b5d51aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.060219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5235b6-2944-408b-82d3-5fa9b5d51aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.060955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5235b6-2944-408b-82d3-5fa9b5d51aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:49.063069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5235b6-2944-408b-82d3-5fa9b5d51aa8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:49.087371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 853/1703] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:49.089274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f5a38-0004-4810-baa8-289e36f6b304 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.126122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 851/1704] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:48 2022] POST /identity/v3/projects => generated 391 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:49.127722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5235b6-2944-408b-82d3-5fa9b5d51aa8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.127940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f5a38-0004-4810-baa8-289e36f6b304 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:49.282834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4082d-2c6d-49ef-ace9-b1e05647266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:49.283846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4082d-2c6d-49ef-ace9-b1e05647266b admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.284282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4082d-2c6d-49ef-ace9-b1e05647266b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.284703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4082d-2c6d-49ef-ace9-b1e05647266b admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.285557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4082d-2c6d-49ef-ace9-b1e05647266b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:49.287786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4082d-2c6d-49ef-ace9-b1e05647266b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:49.306997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5235b6-2944-408b-82d3-5fa9b5d51aa8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:49.323221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6ad74-7d37-4d5e-b2d2-c25dcca8e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:49.324160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6ad74-7d37-4d5e-b2d2-c25dcca8e5ec admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.324519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6ad74-7d37-4d5e-b2d2-c25dcca8e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.326454 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6ad74-7d37-4d5e-b2d2-c25dcca8e5ec admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.327298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6ad74-7d37-4d5e-b2d2-c25dcca8e5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:49.333008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6ad74-7d37-4d5e-b2d2-c25dcca8e5ec admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:49.354775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 854/1705] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:49 2022] POST /identity/v3/projects => generated 387 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:49.360512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4082d-2c6d-49ef-ace9-b1e05647266b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.388936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 852/1706] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:49 2022] POST /identity/v3/users => generated 302 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:49.394168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6ad74-7d37-4d5e-b2d2-c25dcca8e5ec admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.414646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6ad74-7d37-4d5e-b2d2-c25dcca8e5ec admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:49.513847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4082d-2c6d-49ef-ace9-b1e05647266b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:49.540281 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dca21-cff1-4ffb-a1c1-a7498975bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:49.541538 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dca21-cff1-4ffb-a1c1-a7498975bec4 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.547534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dca21-cff1-4ffb-a1c1-a7498975bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.552268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dca21-cff1-4ffb-a1c1-a7498975bec4 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.553174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dca21-cff1-4ffb-a1c1-a7498975bec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:49.557516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dca21-cff1-4ffb-a1c1-a7498975bec4 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:49.592258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b85b76-f078-4363-8ae1-4d624967ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:49.592979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b85b76-f078-4363-8ae1-4d624967ff9d admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.593568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b85b76-f078-4363-8ae1-4d624967ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.593856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b85b76-f078-4363-8ae1-4d624967ff9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.595141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b85b76-f078-4363-8ae1-4d624967ff9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:49.608195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b85b76-f078-4363-8ae1-4d624967ff9d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:49.625153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 855/1707] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:49 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:53:49.628369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dca21-cff1-4ffb-a1c1-a7498975bec4 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.641469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 853/1708] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:53:49.646648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b85b76-f078-4363-8ae1-4d624967ff9d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.650314 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dca21-cff1-4ffb-a1c1-a7498975bec4 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:49.657142 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb5138-39fa-44cb-9240-c5a756ade6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:49.658162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb5138-39fa-44cb-9240-c5a756ade6eb admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.658729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb5138-39fa-44cb-9240-c5a756ade6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.659175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb5138-39fa-44cb-9240-c5a756ade6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.660094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb5138-39fa-44cb-9240-c5a756ade6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:49.661958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b85b76-f078-4363-8ae1-4d624967ff9d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:49.662339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb5138-39fa-44cb-9240-c5a756ade6eb admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:49.668449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af739a5e-e340-412a-a0fe-0b8caed8f732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:49.669841 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af739a5e-e340-412a-a0fe-0b8caed8f732 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.670218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af739a5e-e340-412a-a0fe-0b8caed8f732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.670824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af739a5e-e340-412a-a0fe-0b8caed8f732 admin admin] PATH_INFO: `/v3/projects/56d1586bf2f74c03888bc3cc01c60433/users/ea12870e0fa546b98ed2379ab115f53c/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.678044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 856/1709] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:49.682173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb5138-39fa-44cb-9240-c5a756ade6eb admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.700033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af739a5e-e340-412a-a0fe-0b8caed8f732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d1586bf2f74c03888bc3cc01c60433, user_id=ea12870e0fa546b98ed2379ab115f53c, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:49.703602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af739a5e-e340-412a-a0fe-0b8caed8f732 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:49.705365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb5138-39fa-44cb-9240-c5a756ade6eb admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:49.721170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91bd76-54d4-48d3-a7a7-152fbf626140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:49.722320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91bd76-54d4-48d3-a7a7-152fbf626140 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.722881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91bd76-54d4-48d3-a7a7-152fbf626140 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.729620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91bd76-54d4-48d3-a7a7-152fbf626140 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.737709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 854/1710] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:49 2022] PUT /identity/v3/projects/56d1586bf2f74c03888bc3cc01c60433/users/ea12870e0fa546b98ed2379ab115f53c/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:53:49.738953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af739a5e-e340-412a-a0fe-0b8caed8f732 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.742851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91bd76-54d4-48d3-a7a7-152fbf626140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:49.745150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91bd76-54d4-48d3-a7a7-152fbf626140 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:49.759406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 857/1711] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:49.763951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91bd76-54d4-48d3-a7a7-152fbf626140 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:49.778205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91bd76-54d4-48d3-a7a7-152fbf626140 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:49.873890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713d5ce-7fe2-4bea-8aef-332fe6912dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:49.876083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713d5ce-7fe2-4bea-8aef-332fe6912dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.876621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713d5ce-7fe2-4bea-8aef-332fe6912dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.877102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713d5ce-7fe2-4bea-8aef-332fe6912dfd admin admin] PATH_INFO: `/v3/projects/3100b95272d141bdaddd82778c200e49/users/ce338f33c0334042b241b9dcaed996ff/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.896936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713d5ce-7fe2-4bea-8aef-332fe6912dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3100b95272d141bdaddd82778c200e49, user_id=ce338f33c0334042b241b9dcaed996ff, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:49.900644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713d5ce-7fe2-4bea-8aef-332fe6912dfd admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:49.922692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 858/1712] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:49 2022] PUT /identity/v3/projects/3100b95272d141bdaddd82778c200e49/users/ce338f33c0334042b241b9dcaed996ff/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:49.936534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e00fc9-12d1-493f-a20c-c923218abced None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:49.937037 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e00fc9-12d1-493f-a20c-c923218abced None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:49.937528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e00fc9-12d1-493f-a20c-c923218abced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:49.956987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af739a5e-e340-412a-a0fe-0b8caed8f732 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:50.048940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-49e00fc9-12d1-493f-a20c-c923218abced None None] MFA Rules not processed for user `ce338f33c0334042b241b9dcaed996ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:50.051177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-49e00fc9-12d1-493f-a20c-c923218abced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:50.064582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a0932-449f-4772-9243-9e24e7538ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:50.068608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a0932-449f-4772-9243-9e24e7538ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:50.069156 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a0932-449f-4772-9243-9e24e7538ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:50.069477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a0932-449f-4772-9243-9e24e7538ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:50.074617 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a0932-449f-4772-9243-9e24e7538ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:50.077397 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a0932-449f-4772-9243-9e24e7538ce3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:50.117891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 855/1713] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:50.123533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a0932-449f-4772-9243-9e24e7538ce3 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:50.163149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a0932-449f-4772-9243-9e24e7538ce3 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:50.184854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f695fc5-3c98-4b40-baa3-f62bb7a0a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:50.186554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695fc5-3c98-4b40-baa3-f62bb7a0a2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:50.187068 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695fc5-3c98-4b40-baa3-f62bb7a0a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:50.187560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695fc5-3c98-4b40-baa3-f62bb7a0a2e3 admin admin] PATH_INFO: `/v3/projects/56d1586bf2f74c03888bc3cc01c60433/users/ea12870e0fa546b98ed2379ab115f53c/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:50.198640 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f695fc5-3c98-4b40-baa3-f62bb7a0a2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d1586bf2f74c03888bc3cc01c60433, user_id=ea12870e0fa546b98ed2379ab115f53c, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:50.202859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f695fc5-3c98-4b40-baa3-f62bb7a0a2e3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:50.230558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 859/1714] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:50.231644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e00fc9-12d1-493f-a20c-c923218abced None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:50.240862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 856/1715] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:50 2022] PUT /identity/v3/projects/56d1586bf2f74c03888bc3cc01c60433/users/ea12870e0fa546b98ed2379ab115f53c/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:53:50.254979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755c70-32ef-4e92-afb4-a6f280315b19 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:50.255785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755c70-32ef-4e92-afb4-a6f280315b19 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:50.256462 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a755c70-32ef-4e92-afb4-a6f280315b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:50.266922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e00fc9-12d1-493f-a20c-c923218abced None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:50.362657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-7a755c70-32ef-4e92-afb4-a6f280315b19 None None] MFA Rules not processed for user `ea12870e0fa546b98ed2379ab115f53c`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:50.365766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7a755c70-32ef-4e92-afb4-a6f280315b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:50.447286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f82283-fc46-4bf3-b066-9f81d8b3130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:50.450298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f82283-fc46-4bf3-b066-9f81d8b3130c admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:50.450682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f82283-fc46-4bf3-b066-9f81d8b3130c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:50.450923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f82283-fc46-4bf3-b066-9f81d8b3130c admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:50.452673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f82283-fc46-4bf3-b066-9f81d8b3130c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:50.457143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f82283-fc46-4bf3-b066-9f81d8b3130c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:50.579271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 860/1716] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:53:50 2022] POST /identity/v3/projects => generated 385 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:50.581509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f82283-fc46-4bf3-b066-9f81d8b3130c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:50.633670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 857/1717] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:50.642280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c9c61-277b-4e80-91f0-da3d71a11f74 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:50.642763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c9c61-277b-4e80-91f0-da3d71a11f74 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:50.643149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c9c61-277b-4e80-91f0-da3d71a11f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:50.694923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1b2c9c61-277b-4e80-91f0-da3d71a11f74 None None] MFA Rules not processed for user `0207c3cb9a3e408f81ff3f86c5e70285`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:50.699667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1b2c9c61-277b-4e80-91f0-da3d71a11f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:50.715955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f82283-fc46-4bf3-b066-9f81d8b3130c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:50.734898 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7648-10a8-4c3d-a34a-fd2f2489e221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:50.735618 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7648-10a8-4c3d-a34a-fd2f2489e221 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:50.736370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7648-10a8-4c3d-a34a-fd2f2489e221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:50.736370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7648-10a8-4c3d-a34a-fd2f2489e221 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:50.737054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a7648-10a8-4c3d-a34a-fd2f2489e221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:50.740663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a7648-10a8-4c3d-a34a-fd2f2489e221 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:50.796688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 861/1718] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:53:50 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:53:50.796688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7648-10a8-4c3d-a34a-fd2f2489e221 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:50.809752 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-849a7648-10a8-4c3d-a34a-fd2f2489e221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:50.964934 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 858/1719] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:50.976086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c9c61-277b-4e80-91f0-da3d71a11f74 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:50.990128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c9c61-277b-4e80-91f0-da3d71a11f74 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:50.996678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff6dd8-ae84-4b70-b0df-c095ef47733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:50.997274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6dd8-ae84-4b70-b0df-c095ef47733f admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:50.997556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6dd8-ae84-4b70-b0df-c095ef47733f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:50.998227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6dd8-ae84-4b70-b0df-c095ef47733f admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:50.999006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff6dd8-ae84-4b70-b0df-c095ef47733f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:51.001097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff6dd8-ae84-4b70-b0df-c095ef47733f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:51.015125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7648-10a8-4c3d-a34a-fd2f2489e221 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:51.019709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad10c5-77ec-460c-9b8d-511fe8063b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:51.020655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 859/1720] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:51.020995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad10c5-77ec-460c-9b8d-511fe8063b16 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:51.021363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad10c5-77ec-460c-9b8d-511fe8063b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:51.021972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad10c5-77ec-460c-9b8d-511fe8063b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:51.022702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd60a4-274c-4403-aa17-4a6f6b96ff26 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:51.023059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd60a4-274c-4403-aa17-4a6f6b96ff26 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:51.023429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd60a4-274c-4403-aa17-4a6f6b96ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:51.069094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-2ebd60a4-274c-4403-aa17-4a6f6b96ff26 None None] MFA Rules not processed for user `0207c3cb9a3e408f81ff3f86c5e70285`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:51.070514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2ebd60a4-274c-4403-aa17-4a6f6b96ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:51.092159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 860/1721] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:51.092159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd60a4-274c-4403-aa17-4a6f6b96ff26 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:51.134809 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd60a4-274c-4403-aa17-4a6f6b96ff26 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:51.145127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad10c5-77ec-460c-9b8d-511fe8063b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:51.148083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad10c5-77ec-460c-9b8d-511fe8063b16 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:51.158281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1f96f-f7c3-4df3-9ce9-3b2d2f7d9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:51.159462 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1f96f-f7c3-4df3-9ce9-3b2d2f7d9d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:51.159646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1f96f-f7c3-4df3-9ce9-3b2d2f7d9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:51.159930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1f96f-f7c3-4df3-9ce9-3b2d2f7d9d13 admin admin] PATH_INFO: `/v3/projects/bbbe3e8f01c24a74af7890c0cc8f89fc/users/d54c1366da3e4497bcd94176e8af1510/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:51.191308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 862/1722] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:51.192329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad10c5-77ec-460c-9b8d-511fe8063b16 service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:51.212249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1f96f-f7c3-4df3-9ce9-3b2d2f7d9d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbe3e8f01c24a74af7890c0cc8f89fc, user_id=d54c1366da3e4497bcd94176e8af1510, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:51.215323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1f96f-f7c3-4df3-9ce9-3b2d2f7d9d13 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:51.254870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 861/1723] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:51 2022] PUT /identity/v3/projects/bbbe3e8f01c24a74af7890c0cc8f89fc/users/d54c1366da3e4497bcd94176e8af1510/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:51.257590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1f96f-f7c3-4df3-9ce9-3b2d2f7d9d13 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:51.384674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad10c5-77ec-460c-9b8d-511fe8063b16 service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:51.416382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1f96f-f7c3-4df3-9ce9-3b2d2f7d9d13 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:51.421589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e4584-2964-4b5a-aedd-ec18c4724567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:51.422343 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4584-2964-4b5a-aedd-ec18c4724567 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:51.422785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4584-2964-4b5a-aedd-ec18c4724567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:51.423077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4584-2964-4b5a-aedd-ec18c4724567 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:51.423833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e4584-2964-4b5a-aedd-ec18c4724567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:51.425505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e4584-2964-4b5a-aedd-ec18c4724567 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:51.441673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 862/1724] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:53:51.441673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e4584-2964-4b5a-aedd-ec18c4724567 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:51.441673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f67e4584-2964-4b5a-aedd-ec18c4724567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:51.564968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b345-9f82-4ede-ad78-8f9bab7f06e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:51.565831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b345-9f82-4ede-ad78-8f9bab7f06e5 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:51.566250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b345-9f82-4ede-ad78-8f9bab7f06e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:51.566935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b345-9f82-4ede-ad78-8f9bab7f06e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:51.613409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e4584-2964-4b5a-aedd-ec18c4724567 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:51.617907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96f59-9860-4ba8-965c-b403684cd950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:51.622158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96f59-9860-4ba8-965c-b403684cd950 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:51.623186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96f59-9860-4ba8-965c-b403684cd950 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:51.623560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96f59-9860-4ba8-965c-b403684cd950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:51.773103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220b345-9f82-4ede-ad78-8f9bab7f06e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:51.776500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220b345-9f82-4ede-ad78-8f9bab7f06e5 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:51.795478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee96f59-9860-4ba8-965c-b403684cd950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:51.796990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee96f59-9860-4ba8-965c-b403684cd950 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:51.815621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 863/1725] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:51.815840 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96f59-9860-4ba8-965c-b403684cd950 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:51.818213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 863/1726] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:51.848489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96f59-9860-4ba8-965c-b403684cd950 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:51.870348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff27136-c9ff-44f6-8d00-3c9c3b0439d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:51.871446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff27136-c9ff-44f6-8d00-3c9c3b0439d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:51.871735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff27136-c9ff-44f6-8d00-3c9c3b0439d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:51.872022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff27136-c9ff-44f6-8d00-3c9c3b0439d6 admin admin] PATH_INFO: `/v3/projects/bbbe3e8f01c24a74af7890c0cc8f89fc/users/d54c1366da3e4497bcd94176e8af1510/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:51.880628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff27136-c9ff-44f6-8d00-3c9c3b0439d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbe3e8f01c24a74af7890c0cc8f89fc, user_id=d54c1366da3e4497bcd94176e8af1510, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:51.891708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff27136-c9ff-44f6-8d00-3c9c3b0439d6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:51.934539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 864/1727] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:53:51 2022] PUT /identity/v3/projects/bbbe3e8f01c24a74af7890c0cc8f89fc/users/d54c1366da3e4497bcd94176e8af1510/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:53:51.946288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371abed-dc2a-4a2b-a71d-17b9cdd03924 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:51.947019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371abed-dc2a-4a2b-a71d-17b9cdd03924 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:51.947451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371abed-dc2a-4a2b-a71d-17b9cdd03924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:51.992279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-b371abed-dc2a-4a2b-a71d-17b9cdd03924 None None] MFA Rules not processed for user `d54c1366da3e4497bcd94176e8af1510`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:51.994765 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b371abed-dc2a-4a2b-a71d-17b9cdd03924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:52.138559 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 864/1728] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:52.155178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff27136-c9ff-44f6-8d00-3c9c3b0439d6 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:52.336734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff27136-c9ff-44f6-8d00-3c9c3b0439d6 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:52.352385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0fd52-d369-4757-8ad8-95f6751079ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:52.353395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0fd52-d369-4757-8ad8-95f6751079ad service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:52.353808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0fd52-d369-4757-8ad8-95f6751079ad service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:52.354257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0fd52-d369-4757-8ad8-95f6751079ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:52.370120 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1714af-865e-471b-b501-b0700750025f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:52.370631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1714af-865e-471b-b501-b0700750025f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:52.371099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1714af-865e-471b-b501-b0700750025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:52.392295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0fd52-d369-4757-8ad8-95f6751079ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:52.394901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0fd52-d369-4757-8ad8-95f6751079ad service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:52.432966 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-3d1714af-865e-471b-b501-b0700750025f None None] MFA Rules not processed for user `9680269cd8504c36b6027040e185a817`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:52.435017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3d1714af-865e-471b-b501-b0700750025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:52.436542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 865/1729] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:52.596398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 865/1730] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:53.330217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0fd52-d369-4757-8ad8-95f6751079ad service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:53.337721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-98b0fd52-d369-4757-8ad8-95f6751079ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:53.619990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0fd52-d369-4757-8ad8-95f6751079ad service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:53.646703 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3f51-182e-4db6-81d0-7f2ed9bbee4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:53.650959 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3f51-182e-4db6-81d0-7f2ed9bbee4c service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:53.651301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3f51-182e-4db6-81d0-7f2ed9bbee4c service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:53.653995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3f51-182e-4db6-81d0-7f2ed9bbee4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:53.700536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc3f51-182e-4db6-81d0-7f2ed9bbee4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:53.702811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc3f51-182e-4db6-81d0-7f2ed9bbee4c service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:53.703981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdc45c-49da-4794-9842-1d77374b66e4 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:53.704486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdc45c-49da-4794-9842-1d77374b66e4 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:53.707507 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdc45c-49da-4794-9842-1d77374b66e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:53.742588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 866/1731] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:53.755061 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-88fdc45c-49da-4794-9842-1d77374b66e4 None None] MFA Rules not processed for user `0207c3cb9a3e408f81ff3f86c5e70285`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:53.756466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-88fdc45c-49da-4794-9842-1d77374b66e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:54.022548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 866/1732] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:54.204951 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3f51-182e-4db6-81d0-7f2ed9bbee4c service nova] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:54.215840 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3f51-182e-4db6-81d0-7f2ed9bbee4c service nova] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:54.223358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6541b-56b5-47ff-9198-de60a82de52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:54.224117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6541b-56b5-47ff-9198-de60a82de52b service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:54.224491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6541b-56b5-47ff-9198-de60a82de52b service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:54.224835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6541b-56b5-47ff-9198-de60a82de52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:54.524821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6541b-56b5-47ff-9198-de60a82de52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:54.531834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6541b-56b5-47ff-9198-de60a82de52b service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:54.560607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 867/1733] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:53:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:53:55.098262 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08adc6-1530-409b-ac01-e5d7d3271044 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:55.098800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08adc6-1530-409b-ac01-e5d7d3271044 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:55.098800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08adc6-1530-409b-ac01-e5d7d3271044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:55.162763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6b08adc6-1530-409b-ac01-e5d7d3271044 None None] MFA Rules not processed for user `3763d1d3f1cd46058e1979062d084de5`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:55.176073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6b08adc6-1530-409b-ac01-e5d7d3271044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:55.359808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 867/1734] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:53:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:56.958657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921b73-afbb-4a92-8bc5-ed76edb9beb1 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:56.958657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921b73-afbb-4a92-8bc5-ed76edb9beb1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:56.958657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921b73-afbb-4a92-8bc5-ed76edb9beb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:56.983594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6e921b73-afbb-4a92-8bc5-ed76edb9beb1 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:53:56.985103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6e921b73-afbb-4a92-8bc5-ed76edb9beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:57.206069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 868/1735] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 19:53:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:53:57.671215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08adc6-1530-409b-ac01-e5d7d3271044 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:53:57.674671 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6b08adc6-1530-409b-ac01-e5d7d3271044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:53:58.013617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08adc6-1530-409b-ac01-e5d7d3271044 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:53:58.026363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc6622-504d-418e-9e44-dc58ff6baceb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:53:58.027959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6622-504d-418e-9e44-dc58ff6baceb service swift] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:53:58.028399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6622-504d-418e-9e44-dc58ff6baceb service swift] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:53:58.028822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6622-504d-418e-9e44-dc58ff6baceb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:53:58.069627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc6622-504d-418e-9e44-dc58ff6baceb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:53:58.071381 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc6622-504d-418e-9e44-dc58ff6baceb service swift] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:53:58.117303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 868/1736] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 19:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 22 19:54:03.369076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822a02-44de-4f80-8096-32146f9ca2ec None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:03.370681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822a02-44de-4f80-8096-32146f9ca2ec None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:03.373170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822a02-44de-4f80-8096-32146f9ca2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:03.449509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc6622-504d-418e-9e44-dc58ff6baceb service swift] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:03.450111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8b822a02-44de-4f80-8096-32146f9ca2ec None None] MFA Rules not processed for user `c2e837368cdc4df29d945a4c8e662a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:03.451589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8b822a02-44de-4f80-8096-32146f9ca2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:03.466316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc6622-504d-418e-9e44-dc58ff6baceb service swift] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:03.485173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e25b14-4c6b-46b4-933a-87d818f9bc0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:03.494631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e25b14-4c6b-46b4-933a-87d818f9bc0b service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:03.495224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e25b14-4c6b-46b4-933a-87d818f9bc0b service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:03.496695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e25b14-4c6b-46b4-933a-87d818f9bc0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:03.587391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 869/1737] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Mar 22 19:54:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:03.695534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b822a02-44de-4f80-8096-32146f9ca2ec None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:03.697763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8b822a02-44de-4f80-8096-32146f9ca2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:03.735541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b822a02-44de-4f80-8096-32146f9ca2ec None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:03.760245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e25b14-4c6b-46b4-933a-87d818f9bc0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:03.766349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7667f0-d474-4ae7-adbd-0f48fbe9687a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:03.767217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7667f0-d474-4ae7-adbd-0f48fbe9687a service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:03.767611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7667f0-d474-4ae7-adbd-0f48fbe9687a service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:03.767989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7667f0-d474-4ae7-adbd-0f48fbe9687a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:03.768365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e25b14-4c6b-46b4-933a-87d818f9bc0b service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:03.793647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7667f0-d474-4ae7-adbd-0f48fbe9687a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:03.803620 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7667f0-d474-4ae7-adbd-0f48fbe9687a service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:03.813186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 869/1738] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:03.818035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e25b14-4c6b-46b4-933a-87d818f9bc0b service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:03.856727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 870/1739] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:04.006409 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e25b14-4c6b-46b4-933a-87d818f9bc0b service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:04.023349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:04.025105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:04.025396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:04.025680 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] PATH_INFO: `/v3/users/c99d076cfd2443bfb33b5b3d9f2906d7` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:04.027669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99d076cfd2443bfb33b5b3d9f2906d7)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:04.031395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:04.252227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99d076cfd2443bfb33b5b3d9f2906d7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:04.280698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99d076cfd2443bfb33b5b3d9f2906d7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:04.298010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99d076cfd2443bfb33b5b3d9f2906d7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:04.301031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99d076cfd2443bfb33b5b3d9f2906d7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:04.328100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99d076cfd2443bfb33b5b3d9f2906d7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:04.340262 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 870/1740] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:03 2022] DELETE /identity/v3/users/c99d076cfd2443bfb33b5b3d9f2906d7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:04.346313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb03787-5145-4d3f-9cfd-67b0487a9e3e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:04.347025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb03787-5145-4d3f-9cfd-67b0487a9e3e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:04.347731 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb03787-5145-4d3f-9cfd-67b0487a9e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:04.438270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-abb03787-5145-4d3f-9cfd-67b0487a9e3e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:04.441810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-abb03787-5145-4d3f-9cfd-67b0487a9e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:04.854084 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 871/1741] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:04.885803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:04.889497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:05.385859 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6ade-1596-4534-931f-779cc20dfb74 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:05.386566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb03787-5145-4d3f-9cfd-67b0487a9e3e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:05.388845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-abb03787-5145-4d3f-9cfd-67b0487a9e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:05.417049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e0171-eab4-4d3a-8b73-ab510c34f058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:05.418966 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0171-eab4-4d3a-8b73-ab510c34f058 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:05.420130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0171-eab4-4d3a-8b73-ab510c34f058 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:05.426374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0171-eab4-4d3a-8b73-ab510c34f058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:05.461380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb03787-5145-4d3f-9cfd-67b0487a9e3e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:05.502957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630452a2-c590-4709-9106-974702954b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:05.506507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630452a2-c590-4709-9106-974702954b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:05.507197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630452a2-c590-4709-9106-974702954b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:05.509994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630452a2-c590-4709-9106-974702954b78 admin admin] PATH_INFO: `/v3/users/d567258032bd493eb8bedaaeda849d7c` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:05.511854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e0171-eab4-4d3a-8b73-ab510c34f058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:05.518188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630452a2-c590-4709-9106-974702954b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d567258032bd493eb8bedaaeda849d7c)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:05.520863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e0171-eab4-4d3a-8b73-ab510c34f058 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:05.526261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630452a2-c590-4709-9106-974702954b78 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:05.602436 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 871/1742] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:05.750723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-630452a2-c590-4709-9106-974702954b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd567258032bd493eb8bedaaeda849d7c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:05.753324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-630452a2-c590-4709-9106-974702954b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd567258032bd493eb8bedaaeda849d7c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:05.761291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-630452a2-c590-4709-9106-974702954b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd567258032bd493eb8bedaaeda849d7c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:05.781208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-630452a2-c590-4709-9106-974702954b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd567258032bd493eb8bedaaeda849d7c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:05.809051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-630452a2-c590-4709-9106-974702954b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd567258032bd493eb8bedaaeda849d7c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:05.859908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 872/1743] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:05 2022] DELETE /identity/v3/users/d567258032bd493eb8bedaaeda849d7c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:05.864432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b37ba-f77a-4039-af82-2eea33958880 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:05.865071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b37ba-f77a-4039-af82-2eea33958880 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:05.865551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b37ba-f77a-4039-af82-2eea33958880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:05.902873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-556b37ba-f77a-4039-af82-2eea33958880 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:05.907551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-556b37ba-f77a-4039-af82-2eea33958880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:06.121655 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 872/1744] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:06.360078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630452a2-c590-4709-9106-974702954b78 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:06.362425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-630452a2-c590-4709-9106-974702954b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:06.566268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630452a2-c590-4709-9106-974702954b78 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:06.581705 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c4e09-7b9d-440c-8946-aedc24916fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:06.582792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c4e09-7b9d-440c-8946-aedc24916fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:06.587544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c4e09-7b9d-440c-8946-aedc24916fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:06.588720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c4e09-7b9d-440c-8946-aedc24916fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:06.618164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c4e09-7b9d-440c-8946-aedc24916fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:06.620285 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c4e09-7b9d-440c-8946-aedc24916fd6 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:06.657995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 873/1745] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:08.943704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b37ba-f77a-4039-af82-2eea33958880 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:08.948686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-556b37ba-f77a-4039-af82-2eea33958880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:09.030780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b37ba-f77a-4039-af82-2eea33958880 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:09.110504 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:09.124722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:09.125117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:09.125474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] PATH_INFO: `/v3/projects/6139db26560748ff8b550ca173314bc2` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:09.132819 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6139db26560748ff8b550ca173314bc2)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:09.144134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:09.269201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c4e09-7b9d-440c-8946-aedc24916fd6 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:09.272107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-de6c4e09-7b9d-440c-8946-aedc24916fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:09.314185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c4e09-7b9d-440c-8946-aedc24916fd6 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:09.373199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6139db26560748ff8b550ca173314bc2', 'request_id': 'req-a27fe838-a49f-44c9-b93d-ff614847354c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:09.400379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6139db26560748ff8b550ca173314bc2', 'request_id': 'req-a27fe838-a49f-44c9-b93d-ff614847354c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:09.433583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6139db26560748ff8b550ca173314bc2', 'request_id': 'req-a27fe838-a49f-44c9-b93d-ff614847354c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:09.557570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] The token cache is being invalidate because project 6139db26560748ff8b550ca173314bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:09.558505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:09.568839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:09.586168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 873/1746] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:08 2022] DELETE /identity/v3/projects/6139db26560748ff8b550ca173314bc2 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:09.587320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:09.595676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:09.612858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:09.615770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:09.622665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:09.628150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] PATH_INFO: `/v3/users/f8b079c262bf4a659edc9da4d3d0df23` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:09.639697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b079c262bf4a659edc9da4d3d0df23)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:09.645997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:09.650273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fe838-a49f-44c9-b93d-ff614847354c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:09.696873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:09.698296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:09.699437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:09.699887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] PATH_INFO: `/v3/users/ea12870e0fa546b98ed2379ab115f53c` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:09.707342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea12870e0fa546b98ed2379ab115f53c)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:09.745434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:09.816327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b079c262bf4a659edc9da4d3d0df23'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:09.821916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b079c262bf4a659edc9da4d3d0df23'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:09.824497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b079c262bf4a659edc9da4d3d0df23'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:09.879770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b079c262bf4a659edc9da4d3d0df23'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:09.903874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b497cccc-3be7-4c8e-9431-f9325b7a297d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b079c262bf4a659edc9da4d3d0df23'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:10.006450 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 874/1747] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:09 2022] DELETE /identity/v3/users/f8b079c262bf4a659edc9da4d3d0df23 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:10.014044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d060df-108c-42e7-8528-961dc1c6f9c5 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:10.015000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d060df-108c-42e7-8528-961dc1c6f9c5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:10.016654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d060df-108c-42e7-8528-961dc1c6f9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:10.069086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea12870e0fa546b98ed2379ab115f53c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:10.126060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-31d060df-108c-42e7-8528-961dc1c6f9c5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:10.127496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-31d060df-108c-42e7-8528-961dc1c6f9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:10.139332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea12870e0fa546b98ed2379ab115f53c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:10.190925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea12870e0fa546b98ed2379ab115f53c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:10.192255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea12870e0fa546b98ed2379ab115f53c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:10.209677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea12870e0fa546b98ed2379ab115f53c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:10.231893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 874/1748] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:09 2022] DELETE /identity/v3/users/ea12870e0fa546b98ed2379ab115f53c => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:10.335144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 875/1749] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:10.742150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:10.744586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:10.888015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d060df-108c-42e7-8528-961dc1c6f9c5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:10.890286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-31d060df-108c-42e7-8528-961dc1c6f9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:10.920020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d060df-108c-42e7-8528-961dc1c6f9c5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:11.051930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dffbf-1795-4686-bd3e-f5c791f79635 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:11.075258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc317c5-e847-4671-89ad-655d7e63186e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:11.076697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc317c5-e847-4671-89ad-655d7e63186e service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:11.077126 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc317c5-e847-4671-89ad-655d7e63186e service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:11.081497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc317c5-e847-4671-89ad-655d7e63186e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:11.239381 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc317c5-e847-4671-89ad-655d7e63186e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:11.240931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc317c5-e847-4671-89ad-655d7e63186e service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:11.270192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 875/1750] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:11.271621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948d4d2-ef56-4ec5-891e-790af33b3c66 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:11.271906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948d4d2-ef56-4ec5-891e-790af33b3c66 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:11.272547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948d4d2-ef56-4ec5-891e-790af33b3c66 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:11.277523 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 876/1751] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 19:54:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:54:11.281381 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:11.288854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:11.289831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:11.290676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] PATH_INFO: `/v3/projects/9a67309e48e0450c9eaff21ba9315b62` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:11.295018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a67309e48e0450c9eaff21ba9315b62)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:11.338912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:11.419569 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7008-d456-4c12-9718-5af2c5d826ad None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:11.420018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7008-d456-4c12-9718-5af2c5d826ad None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:11.420493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac7008-d456-4c12-9718-5af2c5d826ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:11.503424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-94ac7008-d456-4c12-9718-5af2c5d826ad None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:11.505508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-94ac7008-d456-4c12-9718-5af2c5d826ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:11.603151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a67309e48e0450c9eaff21ba9315b62', 'request_id': 'req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:11.640391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a67309e48e0450c9eaff21ba9315b62', 'request_id': 'req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:11.663791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a67309e48e0450c9eaff21ba9315b62', 'request_id': 'req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:11.721013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 877/1752] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:11.756035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] The token cache is being invalidate because project 9a67309e48e0450c9eaff21ba9315b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:11.757026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:11.761956 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6309ea0d-1795-45a2-8a5e-6c90e95ccf7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:11.771687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 876/1753] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:10 2022] DELETE /identity/v3/projects/9a67309e48e0450c9eaff21ba9315b62 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:11.773055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac7008-d456-4c12-9718-5af2c5d826ad None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:11.960106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac7008-d456-4c12-9718-5af2c5d826ad None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:11.973670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:11.974405 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:11.974753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:11.975083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] PATH_INFO: `/v3/users/e66ca45068ad4bbd8cb10c348d4c1ddf` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:11.979616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66ca45068ad4bbd8cb10c348d4c1ddf)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:11.986266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:12.057497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c05a7-d85b-4c0a-b769-d3ea2760d303 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:12.057921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c05a7-d85b-4c0a-b769-d3ea2760d303 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:12.057921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c05a7-d85b-4c0a-b769-d3ea2760d303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:12.134091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-013c05a7-d85b-4c0a-b769-d3ea2760d303 None None] MFA Rules not processed for user `9680269cd8504c36b6027040e185a817`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:12.140894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-013c05a7-d85b-4c0a-b769-d3ea2760d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:12.154161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66ca45068ad4bbd8cb10c348d4c1ddf'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:12.199054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66ca45068ad4bbd8cb10c348d4c1ddf'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:12.222738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66ca45068ad4bbd8cb10c348d4c1ddf'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:12.223630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66ca45068ad4bbd8cb10c348d4c1ddf'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:12.247214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6de0dcdc-2207-498d-8638-c76320b23302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66ca45068ad4bbd8cb10c348d4c1ddf'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:12.293607 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 878/1754] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:11 2022] DELETE /identity/v3/users/e66ca45068ad4bbd8cb10c348d4c1ddf => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:12.488453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 877/1755] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:12.542060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d65c2f-780c-4555-a5ec-d2385478d31a None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:12.542380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d65c2f-780c-4555-a5ec-d2385478d31a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:12.542810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d65c2f-780c-4555-a5ec-d2385478d31a None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:12.545277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 879/1756] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 19:54:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 22 19:54:12.555651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989df79-a9fa-4c2f-867f-e5b5f0d56fe1 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:12.556181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989df79-a9fa-4c2f-867f-e5b5f0d56fe1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:12.556591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989df79-a9fa-4c2f-867f-e5b5f0d56fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:12.625742 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c989df79-a9fa-4c2f-867f-e5b5f0d56fe1 None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:12.629715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c989df79-a9fa-4c2f-867f-e5b5f0d56fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:13.027540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 878/1757] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 19:54:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:13.945213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d65c2f-780c-4555-a5ec-d2385478d31a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:13.960305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a6d65c2f-780c-4555-a5ec-d2385478d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:14.062359 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d65c2f-780c-4555-a5ec-d2385478d31a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:14.088951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9d1a-9032-4781-af8e-74c57b1d652f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:14.101789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9d1a-9032-4781-af8e-74c57b1d652f service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:14.104851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9d1a-9032-4781-af8e-74c57b1d652f service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:14.105478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9d1a-9032-4781-af8e-74c57b1d652f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:14.110475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9b9c9d1a-9032-4781-af8e-74c57b1d652f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:14.146499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c9d1a-9032-4781-af8e-74c57b1d652f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:14.151494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c9d1a-9032-4781-af8e-74c57b1d652f service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:14.180474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 880/1758] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:14.461681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9d1a-9032-4781-af8e-74c57b1d652f service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:14.463007 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989df79-a9fa-4c2f-867f-e5b5f0d56fe1 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:14.472230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c989df79-a9fa-4c2f-867f-e5b5f0d56fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:14.477664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9d1a-9032-4781-af8e-74c57b1d652f service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:14.503384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfe17-615c-4389-bc45-db4c2968f87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:14.510561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfe17-615c-4389-bc45-db4c2968f87a service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:14.511103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfe17-615c-4389-bc45-db4c2968f87a service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:14.512648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfe17-615c-4389-bc45-db4c2968f87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:14.554068 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bfe17-615c-4389-bc45-db4c2968f87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:14.567864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bfe17-615c-4389-bc45-db4c2968f87a service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:14.601104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 881/1759] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:14.787785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989df79-a9fa-4c2f-867f-e5b5f0d56fe1 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:14.809134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:14.814032 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:14.815654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:14.818476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] PATH_INFO: `/v3/projects/56d1586bf2f74c03888bc3cc01c60433` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:14.825036 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d1586bf2f74c03888bc3cc01c60433)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:14.840208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:14.876741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfe17-615c-4389-bc45-db4c2968f87a service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:14.879645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-863bfe17-615c-4389-bc45-db4c2968f87a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:14.986419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfe17-615c-4389-bc45-db4c2968f87a service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:15.018977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:15.023303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:15.023887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:15.027364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] PATH_INFO: `/v3/projects/766682daffb246a090e32e8f4a8bad2b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:15.036620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=766682daffb246a090e32e8f4a8bad2b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:15.047834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d1586bf2f74c03888bc3cc01c60433', 'request_id': 'req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.052005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:15.063412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d1586bf2f74c03888bc3cc01c60433', 'request_id': 'req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.086373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d1586bf2f74c03888bc3cc01c60433', 'request_id': 'req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.122111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] The token cache is being invalidate because project 56d1586bf2f74c03888bc3cc01c60433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:15.123133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.126250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2ae2435b-7630-45f9-a0e6-29c7a1d224dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.131971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 879/1760] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:14 2022] DELETE /identity/v3/projects/56d1586bf2f74c03888bc3cc01c60433 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:15.140489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37870d68-67e3-49e3-ab4e-d7d5e705a7ec None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:15.140883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37870d68-67e3-49e3-ab4e-d7d5e705a7ec None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:15.141099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37870d68-67e3-49e3-ab4e-d7d5e705a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:15.192843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-37870d68-67e3-49e3-ab4e-d7d5e705a7ec None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:15.198718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-37870d68-67e3-49e3-ab4e-d7d5e705a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:15.207189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766682daffb246a090e32e8f4a8bad2b', 'request_id': 'req-a8f8dae0-f595-4e14-8a9b-88b6e963a253'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.222053 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766682daffb246a090e32e8f4a8bad2b', 'request_id': 'req-a8f8dae0-f595-4e14-8a9b-88b6e963a253'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.234180 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766682daffb246a090e32e8f4a8bad2b', 'request_id': 'req-a8f8dae0-f595-4e14-8a9b-88b6e963a253'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.279610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] The token cache is being invalidate because project 766682daffb246a090e32e8f4a8bad2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:15.280178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.283334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.308444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 882/1761] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:14 2022] DELETE /identity/v3/projects/766682daffb246a090e32e8f4a8bad2b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:15.315608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:15.328142 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:15.386639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 880/1762] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:15.399254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a3df-e940-477f-a7ef-e13683af6309 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:15.399778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a3df-e940-477f-a7ef-e13683af6309 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:15.400251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a3df-e940-477f-a7ef-e13683af6309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:15.438923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9548a3df-e940-477f-a7ef-e13683af6309 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:15.442571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9548a3df-e940-477f-a7ef-e13683af6309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:15.475014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 881/1763] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:15.476135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548a3df-e940-477f-a7ef-e13683af6309 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:15.480560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8dae0-f595-4e14-8a9b-88b6e963a253 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:15.487794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:15.489271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:15.489986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:15.490484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] PATH_INFO: `/v3/users/ce338f33c0334042b241b9dcaed996ff` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:15.492421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce338f33c0334042b241b9dcaed996ff)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:15.495022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:15.502208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548a3df-e940-477f-a7ef-e13683af6309 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:15.518576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae48210-13ec-4e7c-9ad3-90cf159a940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:15.519288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae48210-13ec-4e7c-9ad3-90cf159a940b admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:15.523056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae48210-13ec-4e7c-9ad3-90cf159a940b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:15.523056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae48210-13ec-4e7c-9ad3-90cf159a940b admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:15.523610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae48210-13ec-4e7c-9ad3-90cf159a940b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:15.523782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae48210-13ec-4e7c-9ad3-90cf159a940b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:15.528590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae48210-13ec-4e7c-9ad3-90cf159a940b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:15.571947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 882/1764] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:54:15.573796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae48210-13ec-4e7c-9ad3-90cf159a940b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:15.617346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae48210-13ec-4e7c-9ad3-90cf159a940b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:15.618760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce338f33c0334042b241b9dcaed996ff'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.659046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce338f33c0334042b241b9dcaed996ff'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.668429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10ba23-4f49-4596-a2a1-b66ce17d709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:15.671701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10ba23-4f49-4596-a2a1-b66ce17d709a admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:15.672241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10ba23-4f49-4596-a2a1-b66ce17d709a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:15.672779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10ba23-4f49-4596-a2a1-b66ce17d709a admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:15.676241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10ba23-4f49-4596-a2a1-b66ce17d709a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:15.687573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10ba23-4f49-4596-a2a1-b66ce17d709a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:15.689307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce338f33c0334042b241b9dcaed996ff'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.693287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce338f33c0334042b241b9dcaed996ff'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.739048 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce338f33c0334042b241b9dcaed996ff'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:15.749206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 883/1765] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:15 2022] DELETE /identity/v3/users/ce338f33c0334042b241b9dcaed996ff => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:15.749206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:15.755025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:15.824224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 883/1766] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:15 2022] POST /identity/v3/projects => generated 401 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:15.832215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10ba23-4f49-4596-a2a1-b66ce17d709a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:15.842815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-df10ba23-4f49-4596-a2a1-b66ce17d709a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:16.043919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b92e43-5c6f-401e-ba76-73b2f30170e9 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:16.078026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:16.098132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10ba23-4f49-4596-a2a1-b66ce17d709a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:16.100664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:16.103637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:16.104372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] PATH_INFO: `/v3/projects/77f68210321d4532ba50492ddaeb4142` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:16.118647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f68210321d4532ba50492ddaeb4142)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:16.124028 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4d56a-6856-4edd-ab76-199f8664dbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:16.128367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d56a-6856-4edd-ab76-199f8664dbcc admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:16.128889 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d56a-6856-4edd-ab76-199f8664dbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:16.136844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:16.138406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d56a-6856-4edd-ab76-199f8664dbcc admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:16.141073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4d56a-6856-4edd-ab76-199f8664dbcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:16.180572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4d56a-6856-4edd-ab76-199f8664dbcc admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:16.299772 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 884/1767] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:15 2022] POST /identity/v3/users => generated 301 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:16.306723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4d56a-6856-4edd-ab76-199f8664dbcc admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:16.338319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4d56a-6856-4edd-ab76-199f8664dbcc admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:16.358871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d4dbc-4543-4970-bf26-9d3404f1f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:16.361534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d4dbc-4543-4970-bf26-9d3404f1f7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:16.362042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d4dbc-4543-4970-bf26-9d3404f1f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:16.364081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d4dbc-4543-4970-bf26-9d3404f1f7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:16.365104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d4dbc-4543-4970-bf26-9d3404f1f7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:16.377619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d4dbc-4543-4970-bf26-9d3404f1f7c4 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:16.406522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 885/1768] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:16.413212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d4dbc-4543-4970-bf26-9d3404f1f7c4 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:16.437444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f68210321d4532ba50492ddaeb4142', 'request_id': 'req-2eb33463-934e-4bd7-a077-1fce8353b396'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:16.448277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d4dbc-4543-4970-bf26-9d3404f1f7c4 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:16.471400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f68210321d4532ba50492ddaeb4142', 'request_id': 'req-2eb33463-934e-4bd7-a077-1fce8353b396'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:16.491109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f68210321d4532ba50492ddaeb4142', 'request_id': 'req-2eb33463-934e-4bd7-a077-1fce8353b396'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:16.511600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] The token cache is being invalidate because project 77f68210321d4532ba50492ddaeb4142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:16.511926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:16.512691 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2eb33463-934e-4bd7-a077-1fce8353b396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:16.514966 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 884/1769] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:15 2022] DELETE /identity/v3/projects/77f68210321d4532ba50492ddaeb4142 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:16.525046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bb3b6-812b-4526-8360-078d1b2f5cd5 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:16.525825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bb3b6-812b-4526-8360-078d1b2f5cd5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:16.526297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bb3b6-812b-4526-8360-078d1b2f5cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:16.600240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-950bb3b6-812b-4526-8360-078d1b2f5cd5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:16.603706 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-950bb3b6-812b-4526-8360-078d1b2f5cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:16.661354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96b553-f173-4df3-8131-f5e73b2a5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:16.663620 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96b553-f173-4df3-8131-f5e73b2a5ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:16.664203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96b553-f173-4df3-8131-f5e73b2a5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:16.665306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96b553-f173-4df3-8131-f5e73b2a5ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:16.666311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96b553-f173-4df3-8131-f5e73b2a5ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:16.670916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96b553-f173-4df3-8131-f5e73b2a5ca5 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:16.710565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 886/1770] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:16.712955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96b553-f173-4df3-8131-f5e73b2a5ca5 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:16.719324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9b96b553-f173-4df3-8131-f5e73b2a5ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:16.737820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96b553-f173-4df3-8131-f5e73b2a5ca5 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:16.744874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5c840-10e3-4757-b766-42faa736ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:16.746056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5c840-10e3-4757-b766-42faa736ce05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:16.746399 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5c840-10e3-4757-b766-42faa736ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:16.746901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5c840-10e3-4757-b766-42faa736ce05 admin admin] PATH_INFO: `/v3/projects/e1122bae17e04e23bc38093245e8821b/users/5cec9e79a93a4bc28e21a931900eb18d/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:16.764049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 885/1771] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:16.766390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bb3b6-812b-4526-8360-078d1b2f5cd5 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:16.770143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-950bb3b6-812b-4526-8360-078d1b2f5cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:16.775056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5c840-10e3-4757-b766-42faa736ce05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1122bae17e04e23bc38093245e8821b, user_id=5cec9e79a93a4bc28e21a931900eb18d, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:16.778269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5c840-10e3-4757-b766-42faa736ce05 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:16.803310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 887/1772] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:16 2022] PUT /identity/v3/projects/e1122bae17e04e23bc38093245e8821b/users/5cec9e79a93a4bc28e21a931900eb18d/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:16.805699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6042f-b5f7-4ec3-af4c-3ab54ef065fa None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:16.806217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6042f-b5f7-4ec3-af4c-3ab54ef065fa None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:16.806691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6042f-b5f7-4ec3-af4c-3ab54ef065fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:16.809711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bb3b6-812b-4526-8360-078d1b2f5cd5 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:16.834889 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0ad6042f-b5f7-4ec3-af4c-3ab54ef065fa None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:16.840497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0ad6042f-b5f7-4ec3-af4c-3ab54ef065fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:16.935454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:16.936562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:16.936860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:16.939280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] PATH_INFO: `/v3/projects/3100b95272d141bdaddd82778c200e49` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:16.941369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3100b95272d141bdaddd82778c200e49)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:16.958328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:16.976137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 888/1773] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:16.977429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9254b8c-ae43-416f-88af-08c5442d2d36 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:16.977722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9254b8c-ae43-416f-88af-08c5442d2d36 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:16.978026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9254b8c-ae43-416f-88af-08c5442d2d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:17.019507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d9254b8c-ae43-416f-88af-08c5442d2d36 None None] MFA Rules not processed for user `5cec9e79a93a4bc28e21a931900eb18d`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:17.020699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d9254b8c-ae43-416f-88af-08c5442d2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:17.107178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3100b95272d141bdaddd82778c200e49', 'request_id': 'req-5464ea77-3780-4982-95c2-3f0da9d8c3b1'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.126581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3100b95272d141bdaddd82778c200e49', 'request_id': 'req-5464ea77-3780-4982-95c2-3f0da9d8c3b1'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.140939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3100b95272d141bdaddd82778c200e49', 'request_id': 'req-5464ea77-3780-4982-95c2-3f0da9d8c3b1'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.190649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] The token cache is being invalidate because project 3100b95272d141bdaddd82778c200e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:17.193026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.196280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.204315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 886/1774] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:16 2022] DELETE /identity/v3/projects/3100b95272d141bdaddd82778c200e49 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:17.208782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:17.210684 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 889/1775] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:17.211633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9254b8c-ae43-416f-88af-08c5442d2d36 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:17.213880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:17.250400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9254b8c-ae43-416f-88af-08c5442d2d36 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:17.383629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:17.384551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:17.384836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:17.385116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] PATH_INFO: `/v3/users/d54c1366da3e4497bcd94176e8af1510` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:17.385846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464ea77-3780-4982-95c2-3f0da9d8c3b1 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:17.388716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54c1366da3e4497bcd94176e8af1510)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:17.390904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:17.393417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:17.409549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:17.410105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:17.410489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:17.411426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:17.414331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:17.421813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:17.448457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 887/1776] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:54:17.449740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:17.456367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:17.495522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259ae01-b975-4ce3-b57d-9d377bc41bb1 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:17.502317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445254b5-5ac5-44cf-a07d-c1c6527e9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:17.502795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445254b5-5ac5-44cf-a07d-c1c6527e9882 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:17.503258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445254b5-5ac5-44cf-a07d-c1c6527e9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:17.503506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445254b5-5ac5-44cf-a07d-c1c6527e9882 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:17.504272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445254b5-5ac5-44cf-a07d-c1c6527e9882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:17.505138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54c1366da3e4497bcd94176e8af1510'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.506291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54c1366da3e4497bcd94176e8af1510'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.506675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445254b5-5ac5-44cf-a07d-c1c6527e9882 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:17.507341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54c1366da3e4497bcd94176e8af1510'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.517383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54c1366da3e4497bcd94176e8af1510'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.528554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54c1366da3e4497bcd94176e8af1510'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:17.551932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 888/1777] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:17 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:17.552970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445254b5-5ac5-44cf-a07d-c1c6527e9882 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:17.556323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-445254b5-5ac5-44cf-a07d-c1c6527e9882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:17.571453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 890/1778] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:17 2022] DELETE /identity/v3/users/d54c1366da3e4497bcd94176e8af1510 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:17.571453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:17.578436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:17.653128 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445254b5-5ac5-44cf-a07d-c1c6527e9882 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:17.683492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29465fd1-9f65-43cd-8799-ecdad9a301ed admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:17.690565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3702f-f3d6-4219-85d4-76f7021cd2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:17.691415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3702f-f3d6-4219-85d4-76f7021cd2ad admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:17.691826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3702f-f3d6-4219-85d4-76f7021cd2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:17.692184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3702f-f3d6-4219-85d4-76f7021cd2ad admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:17.692993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3702f-f3d6-4219-85d4-76f7021cd2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:17.696143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3702f-f3d6-4219-85d4-76f7021cd2ad admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:17.740405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 891/1779] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:17 2022] POST /identity/v3/users => generated 307 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:17.751078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348f2a8-f7de-4357-8c72-e8a511a6b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:17.752011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f2a8-f7de-4357-8c72-e8a511a6b742 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:17.752542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3702f-f3d6-4219-85d4-76f7021cd2ad admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:17.752925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f2a8-f7de-4357-8c72-e8a511a6b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:17.754158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f2a8-f7de-4357-8c72-e8a511a6b742 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:17.754952 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348f2a8-f7de-4357-8c72-e8a511a6b742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:17.756924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348f2a8-f7de-4357-8c72-e8a511a6b742 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:17.766747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3702f-f3d6-4219-85d4-76f7021cd2ad admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:17.774443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1524e-f65a-403c-9913-2b60c1abd070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:17.775235 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1524e-f65a-403c-9913-2b60c1abd070 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:17.775628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1524e-f65a-403c-9913-2b60c1abd070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:17.776055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1524e-f65a-403c-9913-2b60c1abd070 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:17.777692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1524e-f65a-403c-9913-2b60c1abd070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:17.781162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1524e-f65a-403c-9913-2b60c1abd070 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:17.828030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 892/1780] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:17.834187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1524e-f65a-403c-9913-2b60c1abd070 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:17.837843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 889/1781] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:17 2022] POST /identity/v3/projects => generated 357 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:17.845515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348f2a8-f7de-4357-8c72-e8a511a6b742 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:17.874790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1524e-f65a-403c-9913-2b60c1abd070 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:18.009798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348f2a8-f7de-4357-8c72-e8a511a6b742 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:18.048215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc51848-642d-497c-9b0a-d569bd4ae69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:18.049527 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc51848-642d-497c-9b0a-d569bd4ae69e admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.049898 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc51848-642d-497c-9b0a-d569bd4ae69e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.053755 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc51848-642d-497c-9b0a-d569bd4ae69e admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.055204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc51848-642d-497c-9b0a-d569bd4ae69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:18.060929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc51848-642d-497c-9b0a-d569bd4ae69e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:18.105163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 890/1782] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:17 2022] POST /identity/v3/users => generated 279 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:18.107808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc51848-642d-497c-9b0a-d569bd4ae69e admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:18.126809 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc51848-642d-497c-9b0a-d569bd4ae69e admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:18.135801 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ef1ff-6c49-426d-8f05-26d0718a40eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:18.136962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ef1ff-6c49-426d-8f05-26d0718a40eb admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.142252 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ef1ff-6c49-426d-8f05-26d0718a40eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.142749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ef1ff-6c49-426d-8f05-26d0718a40eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.143749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02412b-d592-4675-9af9-ee8c48430f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:18.143956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ef1ff-6c49-426d-8f05-26d0718a40eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:18.146081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02412b-d592-4675-9af9-ee8c48430f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.146288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ef1ff-6c49-426d-8f05-26d0718a40eb admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:18.146598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02412b-d592-4675-9af9-ee8c48430f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.147385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02412b-d592-4675-9af9-ee8c48430f6f admin admin] PATH_INFO: `/v3/projects/3bbfb336f0c84e909f42cb9ca935f3a7/users/29cf69f4592e4c7c8c7059eb36293add/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.163095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 891/1783] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:18.164095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ef1ff-6c49-426d-8f05-26d0718a40eb admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:18.176958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ef1ff-6c49-426d-8f05-26d0718a40eb admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:18.183255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982d78-f1ec-47a4-9dc0-95b738a89737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:18.183702 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982d78-f1ec-47a4-9dc0-95b738a89737 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.183985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982d78-f1ec-47a4-9dc0-95b738a89737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.184259 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982d78-f1ec-47a4-9dc0-95b738a89737 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.185001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c982d78-f1ec-47a4-9dc0-95b738a89737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:18.187025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c982d78-f1ec-47a4-9dc0-95b738a89737 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:18.205287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 892/1784] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:18.206776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982d78-f1ec-47a4-9dc0-95b738a89737 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:18.216726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02412b-d592-4675-9af9-ee8c48430f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbfb336f0c84e909f42cb9ca935f3a7, user_id=29cf69f4592e4c7c8c7059eb36293add, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:18.219389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982d78-f1ec-47a4-9dc0-95b738a89737 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:18.224568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91b409-2ab1-4335-b6df-6c7d32e90b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:18.225836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91b409-2ab1-4335-b6df-6c7d32e90b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.226149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91b409-2ab1-4335-b6df-6c7d32e90b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.226423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91b409-2ab1-4335-b6df-6c7d32e90b4a admin admin] PATH_INFO: `/v3/projects/a7bd6ee0d8964a95920b5aa19e677d7a/users/71b171b8909f41e4a909a93edeee136f/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.226777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02412b-d592-4675-9af9-ee8c48430f6f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:18.246221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91b409-2ab1-4335-b6df-6c7d32e90b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7bd6ee0d8964a95920b5aa19e677d7a, user_id=71b171b8909f41e4a909a93edeee136f, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:18.250189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91b409-2ab1-4335-b6df-6c7d32e90b4a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:18.295767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 893/1785] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:18 2022] PUT /identity/v3/projects/a7bd6ee0d8964a95920b5aa19e677d7a/users/71b171b8909f41e4a909a93edeee136f/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:18.302467 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 893/1786] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:17 2022] PUT /identity/v3/projects/3bbfb336f0c84e909f42cb9ca935f3a7/users/29cf69f4592e4c7c8c7059eb36293add/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:18.303684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1ef5-b934-46ec-a073-2c5adec3e599 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.304215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1ef5-b934-46ec-a073-2c5adec3e599 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.304680 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1ef5-b934-46ec-a073-2c5adec3e599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.312034 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02412b-d592-4675-9af9-ee8c48430f6f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:18.416275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-de6b1ef5-b934-46ec-a073-2c5adec3e599 None None] MFA Rules not processed for user `71b171b8909f41e4a909a93edeee136f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:18.419352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-de6b1ef5-b934-46ec-a073-2c5adec3e599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:18.478236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02412b-d592-4675-9af9-ee8c48430f6f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:18.585635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236298d6-1c77-4cd0-bd81-4f9cb22b7d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:18.586925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236298d6-1c77-4cd0-bd81-4f9cb22b7d66 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.587344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236298d6-1c77-4cd0-bd81-4f9cb22b7d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.587778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236298d6-1c77-4cd0-bd81-4f9cb22b7d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.588958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236298d6-1c77-4cd0-bd81-4f9cb22b7d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:18.591443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236298d6-1c77-4cd0-bd81-4f9cb22b7d66 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:18.610989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 894/1787] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:18.616918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236298d6-1c77-4cd0-bd81-4f9cb22b7d66 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:18.630947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236298d6-1c77-4cd0-bd81-4f9cb22b7d66 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:18.645152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad80a9-8ce0-47f3-9fee-c5109b339550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:18.645152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad80a9-8ce0-47f3-9fee-c5109b339550 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.645152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad80a9-8ce0-47f3-9fee-c5109b339550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.645152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad80a9-8ce0-47f3-9fee-c5109b339550 admin admin] PATH_INFO: `/v3/projects/3bbfb336f0c84e909f42cb9ca935f3a7/users/29cf69f4592e4c7c8c7059eb36293add/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.645634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad80a9-8ce0-47f3-9fee-c5109b339550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbfb336f0c84e909f42cb9ca935f3a7, user_id=29cf69f4592e4c7c8c7059eb36293add, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:18.661708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad80a9-8ce0-47f3-9fee-c5109b339550 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:18.678718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 895/1788] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:18 2022] PUT /identity/v3/projects/3bbfb336f0c84e909f42cb9ca935f3a7/users/29cf69f4592e4c7c8c7059eb36293add/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:18.701240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380c49-4957-49c3-9244-84568a4f9493 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.702331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380c49-4957-49c3-9244-84568a4f9493 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.702807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380c49-4957-49c3-9244-84568a4f9493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.721855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 894/1789] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:18 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:18.727921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b1ef5-b934-46ec-a073-2c5adec3e599 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:18.745692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b1ef5-b934-46ec-a073-2c5adec3e599 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:18.766057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0c380c49-4957-49c3-9244-84568a4f9493 None None] MFA Rules not processed for user `29cf69f4592e4c7c8c7059eb36293add`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:18.768466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0c380c49-4957-49c3-9244-84568a4f9493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:18.948903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897751b-abca-4642-9d88-266aa3342698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:18.959586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897751b-abca-4642-9d88-266aa3342698 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:18.959586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897751b-abca-4642-9d88-266aa3342698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:18.959586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897751b-abca-4642-9d88-266aa3342698 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:18.962746 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897751b-abca-4642-9d88-266aa3342698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:18.970685 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897751b-abca-4642-9d88-266aa3342698 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:19.022296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 896/1790] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:19.040949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380c49-4957-49c3-9244-84568a4f9493 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:19.045045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0c380c49-4957-49c3-9244-84568a4f9493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:19.073925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 895/1791] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:18 2022] POST /identity/v3/projects => generated 357 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:19.076324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897751b-abca-4642-9d88-266aa3342698 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:19.175491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380c49-4957-49c3-9244-84568a4f9493 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:19.239849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897751b-abca-4642-9d88-266aa3342698 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:19.249615 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7a119-2bf2-4510-a73a-b684784c2a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:19.251071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7a119-2bf2-4510-a73a-b684784c2a41 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:19.252056 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7a119-2bf2-4510-a73a-b684784c2a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:19.252684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7a119-2bf2-4510-a73a-b684784c2a41 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:19.254066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7a119-2bf2-4510-a73a-b684784c2a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:19.257884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7a119-2bf2-4510-a73a-b684784c2a41 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:19.261133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61ed1d-e0f5-41a6-b630-f03281b759c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:19.262393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61ed1d-e0f5-41a6-b630-f03281b759c6 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:19.262900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61ed1d-e0f5-41a6-b630-f03281b759c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:19.263403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61ed1d-e0f5-41a6-b630-f03281b759c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:19.303258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 896/1792] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:19 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:19.308183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7a119-2bf2-4510-a73a-b684784c2a41 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:19.330684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7a119-2bf2-4510-a73a-b684784c2a41 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:19.341693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ba1f8-e9b0-48cb-8077-aabe15f50c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:19.343356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ba1f8-e9b0-48cb-8077-aabe15f50c41 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:19.343846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ba1f8-e9b0-48cb-8077-aabe15f50c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:19.344312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ba1f8-e9b0-48cb-8077-aabe15f50c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:19.345279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ba1f8-e9b0-48cb-8077-aabe15f50c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:19.347212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ba1f8-e9b0-48cb-8077-aabe15f50c41 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:19.433094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 897/1793] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:19.444954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ba1f8-e9b0-48cb-8077-aabe15f50c41 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:19.448930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61ed1d-e0f5-41a6-b630-f03281b759c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:19.463044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61ed1d-e0f5-41a6-b630-f03281b759c6 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:19.497923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ba1f8-e9b0-48cb-8077-aabe15f50c41 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:19.531811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 897/1794] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:19.541997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c653d-bbb2-456a-b94b-508ae1bedfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:19.546572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c653d-bbb2-456a-b94b-508ae1bedfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:19.547481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c653d-bbb2-456a-b94b-508ae1bedfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:19.548329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c653d-bbb2-456a-b94b-508ae1bedfc9 admin admin] PATH_INFO: `/v3/projects/26bb42792f8e4d93b5f0ce8cc463b578/users/681c64b0fd704fe184f8fed0d8793e0e/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:19.576753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c653d-bbb2-456a-b94b-508ae1bedfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bb42792f8e4d93b5f0ce8cc463b578, user_id=681c64b0fd704fe184f8fed0d8793e0e, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:19.585740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c653d-bbb2-456a-b94b-508ae1bedfc9 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:19.603322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 898/1795] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:19 2022] PUT /identity/v3/projects/26bb42792f8e4d93b5f0ce8cc463b578/users/681c64b0fd704fe184f8fed0d8793e0e/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:19.608319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61ed1d-e0f5-41a6-b630-f03281b759c6 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:19.621717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61ed1d-e0f5-41a6-b630-f03281b759c6 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:19.667362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c653d-bbb2-456a-b94b-508ae1bedfc9 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:19.715591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e839e0-ff4f-4cba-88d5-db4b773b0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:19.718752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e839e0-ff4f-4cba-88d5-db4b773b0297 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:19.718752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e839e0-ff4f-4cba-88d5-db4b773b0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:19.719185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e839e0-ff4f-4cba-88d5-db4b773b0297 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:19.720119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e839e0-ff4f-4cba-88d5-db4b773b0297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:19.722417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e839e0-ff4f-4cba-88d5-db4b773b0297 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:19.746485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 898/1796] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:19.757260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e839e0-ff4f-4cba-88d5-db4b773b0297 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:19.769727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c653d-bbb2-456a-b94b-508ae1bedfc9 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:19.780939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e839e0-ff4f-4cba-88d5-db4b773b0297 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:19.783085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:19.783893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:19.784279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:19.784648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:19.786708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:19.788635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2508a5-f019-4353-82a9-a2edb70a958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:19.790159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2508a5-f019-4353-82a9-a2edb70a958e admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:19.791065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2508a5-f019-4353-82a9-a2edb70a958e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:19.793345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2508a5-f019-4353-82a9-a2edb70a958e admin admin] PATH_INFO: `/v3/projects/26bb42792f8e4d93b5f0ce8cc463b578/users/681c64b0fd704fe184f8fed0d8793e0e/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:19.796139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2508a5-f019-4353-82a9-a2edb70a958e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bb42792f8e4d93b5f0ce8cc463b578, user_id=681c64b0fd704fe184f8fed0d8793e0e, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:19.800368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2508a5-f019-4353-82a9-a2edb70a958e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:19.815921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 899/1797] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:19 2022] PUT /identity/v3/projects/26bb42792f8e4d93b5f0ce8cc463b578/users/681c64b0fd704fe184f8fed0d8793e0e/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:19.827874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94de09-4ef0-4b53-b7b7-edb943871741 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:19.828168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94de09-4ef0-4b53-b7b7-edb943871741 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:19.828429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94de09-4ef0-4b53-b7b7-edb943871741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:19.881229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-eb94de09-4ef0-4b53-b7b7-edb943871741 None None] MFA Rules not processed for user `681c64b0fd704fe184f8fed0d8793e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:19.883172 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-eb94de09-4ef0-4b53-b7b7-edb943871741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:19.890119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:19.892137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:19.904265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 899/1798] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:20.011807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 900/1799] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:19 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:20.067871 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:20.069447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:20.082799 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d4d8-df77-4122-8455-17c7e7a6565b service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:20.158496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a1b3-8499-4342-9681-e87c351dc9a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:20.159397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a1b3-8499-4342-9681-e87c351dc9a7 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:20.159903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a1b3-8499-4342-9681-e87c351dc9a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:20.160441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a1b3-8499-4342-9681-e87c351dc9a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:20.174832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589a1b3-8499-4342-9681-e87c351dc9a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:20.177336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589a1b3-8499-4342-9681-e87c351dc9a7 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:20.214425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 900/1800] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:20.496754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94de09-4ef0-4b53-b7b7-edb943871741 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:20.534027 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94de09-4ef0-4b53-b7b7-edb943871741 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:20.548743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58a59c-06e9-4630-9c9c-7f463201acef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:20.549931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a59c-06e9-4630-9c9c-7f463201acef service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:20.550419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a59c-06e9-4630-9c9c-7f463201acef service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:20.550912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a59c-06e9-4630-9c9c-7f463201acef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:20.740124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58a59c-06e9-4630-9c9c-7f463201acef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:20.741723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58a59c-06e9-4630-9c9c-7f463201acef service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:20.754307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 901/1801] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:20 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:20.892740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a1b3-8499-4342-9681-e87c351dc9a7 service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:20.895384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9589a1b3-8499-4342-9681-e87c351dc9a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:21.065021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a1b3-8499-4342-9681-e87c351dc9a7 service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:21.079255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:21.080582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:21.080946 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:21.081166 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] PATH_INFO: `/v3/projects/bbbe3e8f01c24a74af7890c0cc8f89fc` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:21.083038 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbe3e8f01c24a74af7890c0cc8f89fc)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:21.087024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:21.232552 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbe3e8f01c24a74af7890c0cc8f89fc', 'request_id': 'req-11799226-77f9-4d98-add1-4a70adaa910e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:21.240506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbe3e8f01c24a74af7890c0cc8f89fc', 'request_id': 'req-11799226-77f9-4d98-add1-4a70adaa910e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:21.253164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbe3e8f01c24a74af7890c0cc8f89fc', 'request_id': 'req-11799226-77f9-4d98-add1-4a70adaa910e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:21.269206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] The token cache is being invalidate because project bbbe3e8f01c24a74af7890c0cc8f89fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:21.269915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:21.270907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11799226-77f9-4d98-add1-4a70adaa910e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:21.278007 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 901/1802] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:20 2022] DELETE /identity/v3/projects/bbbe3e8f01c24a74af7890c0cc8f89fc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:21.280473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8bbd4-365b-431a-80c9-1c924e277e00 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:21.280473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8bbd4-365b-431a-80c9-1c924e277e00 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:21.280730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8bbd4-365b-431a-80c9-1c924e277e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:21.309580 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b5d8bbd4-365b-431a-80c9-1c924e277e00 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:21.312254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b5d8bbd4-365b-431a-80c9-1c924e277e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:21.452545 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 902/1803] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:21.458047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b861-f9de-49bc-8082-316a2f55ee39 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:21.458554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b861-f9de-49bc-8082-316a2f55ee39 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:21.459097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b861-f9de-49bc-8082-316a2f55ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:21.493677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-2dc4b861-f9de-49bc-8082-316a2f55ee39 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:21.495814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2dc4b861-f9de-49bc-8082-316a2f55ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:21.545806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 902/1804] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:21.551088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8bbd4-365b-431a-80c9-1c924e277e00 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:21.588605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8bbd4-365b-431a-80c9-1c924e277e00 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:21.607317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cd361-63be-485f-b0c2-c02ff8b9f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:21.608727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cd361-63be-485f-b0c2-c02ff8b9f039 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:21.609282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cd361-63be-485f-b0c2-c02ff8b9f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:21.609864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cd361-63be-485f-b0c2-c02ff8b9f039 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:21.611279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cd361-63be-485f-b0c2-c02ff8b9f039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:21.612136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cd361-63be-485f-b0c2-c02ff8b9f039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:21.617630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cd361-63be-485f-b0c2-c02ff8b9f039 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:21.646025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 903/1805] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:54:21.649381 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4b861-f9de-49bc-8082-316a2f55ee39 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:21.671076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4b861-f9de-49bc-8082-316a2f55ee39 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:21.689876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4eab-2de7-485c-909f-b6a4ec223415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:21.689876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4eab-2de7-485c-909f-b6a4ec223415 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:21.689876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4eab-2de7-485c-909f-b6a4ec223415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:21.689876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4eab-2de7-485c-909f-b6a4ec223415 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:21.690438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a4eab-2de7-485c-909f-b6a4ec223415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:21.690438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a4eab-2de7-485c-909f-b6a4ec223415 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:21.753506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cd361-63be-485f-b0c2-c02ff8b9f039 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:21.754325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 903/1806] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:21 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:21.778499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cd361-63be-485f-b0c2-c02ff8b9f039 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:21.953218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cbead-76c6-4eca-990c-740d6e27b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:21.954841 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cbead-76c6-4eca-990c-740d6e27b16d admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:21.956501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cbead-76c6-4eca-990c-740d6e27b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:21.957113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cbead-76c6-4eca-990c-740d6e27b16d admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:21.959534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cbead-76c6-4eca-990c-740d6e27b16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:21.969864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cbead-76c6-4eca-990c-740d6e27b16d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:22.045695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4eab-2de7-485c-909f-b6a4ec223415 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:22.058136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 904/1807] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:21 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:22.063420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4eab-2de7-485c-909f-b6a4ec223415 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:22.076403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c664b1-2e9b-4772-9a4c-a0be5a03f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:22.077149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c664b1-2e9b-4772-9a4c-a0be5a03f475 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:22.077644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c664b1-2e9b-4772-9a4c-a0be5a03f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:22.077919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c664b1-2e9b-4772-9a4c-a0be5a03f475 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:22.079713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c664b1-2e9b-4772-9a4c-a0be5a03f475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:22.082577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c664b1-2e9b-4772-9a4c-a0be5a03f475 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:22.120378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 904/1808] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:22.124652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cbead-76c6-4eca-990c-740d6e27b16d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:22.156725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cbead-76c6-4eca-990c-740d6e27b16d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:22.187853 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a1150-30cc-43e3-9fee-f98c2ee27ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:22.196057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a1150-30cc-43e3-9fee-f98c2ee27ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:22.197729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a1150-30cc-43e3-9fee-f98c2ee27ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:22.198487 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a1150-30cc-43e3-9fee-f98c2ee27ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:22.199307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a1150-30cc-43e3-9fee-f98c2ee27ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:22.200984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a1150-30cc-43e3-9fee-f98c2ee27ed5 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:22.232610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 905/1809] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:22.246705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c664b1-2e9b-4772-9a4c-a0be5a03f475 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:22.296150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c664b1-2e9b-4772-9a4c-a0be5a03f475 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:22.319899 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fde226-90f6-407e-9523-1fe39c43acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:22.322941 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fde226-90f6-407e-9523-1fe39c43acc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:22.326333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fde226-90f6-407e-9523-1fe39c43acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:22.326828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fde226-90f6-407e-9523-1fe39c43acc3 admin admin] PATH_INFO: `/v3/projects/019be2d78fbd4f26b7d8484269f50a66/users/ceb2013c7d114c7dae4a17c4a3754293/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:22.406830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fde226-90f6-407e-9523-1fe39c43acc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019be2d78fbd4f26b7d8484269f50a66, user_id=ceb2013c7d114c7dae4a17c4a3754293, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:22.420297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fde226-90f6-407e-9523-1fe39c43acc3 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:22.481019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 905/1810] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:22 2022] PUT /identity/v3/projects/019be2d78fbd4f26b7d8484269f50a66/users/ceb2013c7d114c7dae4a17c4a3754293/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:22.495012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d26d3-9598-4f6a-af97-472b9b980688 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:22.496867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d26d3-9598-4f6a-af97-472b9b980688 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:22.497290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d26d3-9598-4f6a-af97-472b9b980688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:22.552966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6e4d26d3-9598-4f6a-af97-472b9b980688 None None] MFA Rules not processed for user `ceb2013c7d114c7dae4a17c4a3754293`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:22.555741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6e4d26d3-9598-4f6a-af97-472b9b980688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:22.767453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 906/1811] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:22.776520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fde226-90f6-407e-9523-1fe39c43acc3 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:22.906599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fde226-90f6-407e-9523-1fe39c43acc3 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:22.911706 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c66499-2b02-48f6-9f89-5ddbf6e9c796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:22.912440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c66499-2b02-48f6-9f89-5ddbf6e9c796 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:22.912724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c66499-2b02-48f6-9f89-5ddbf6e9c796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:22.913000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c66499-2b02-48f6-9f89-5ddbf6e9c796 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:22.913712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c66499-2b02-48f6-9f89-5ddbf6e9c796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:22.917016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c66499-2b02-48f6-9f89-5ddbf6e9c796 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:22.959865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 906/1812] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:22 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:22.966460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d26d3-9598-4f6a-af97-472b9b980688 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:23.008817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d26d3-9598-4f6a-af97-472b9b980688 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:23.111759 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4803c56-fc87-4baf-a366-c5dcc5292aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:23.114713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803c56-fc87-4baf-a366-c5dcc5292aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:23.115459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803c56-fc87-4baf-a366-c5dcc5292aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:23.116168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803c56-fc87-4baf-a366-c5dcc5292aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:23.118084 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4803c56-fc87-4baf-a366-c5dcc5292aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:23.120412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4803c56-fc87-4baf-a366-c5dcc5292aa9 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:23.164201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c66499-2b02-48f6-9f89-5ddbf6e9c796 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:23.167870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 907/1813] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:22 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:23.180245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c66499-2b02-48f6-9f89-5ddbf6e9c796 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:23.192313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd7753-a448-4927-8f7a-47eb79b6ed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:23.193489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd7753-a448-4927-8f7a-47eb79b6ed9d admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:23.193823 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd7753-a448-4927-8f7a-47eb79b6ed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:23.194219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd7753-a448-4927-8f7a-47eb79b6ed9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:23.195531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd7753-a448-4927-8f7a-47eb79b6ed9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:23.199025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd7753-a448-4927-8f7a-47eb79b6ed9d admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:23.224697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 907/1814] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:23.229301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4803c56-fc87-4baf-a366-c5dcc5292aa9 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:23.241047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4803c56-fc87-4baf-a366-c5dcc5292aa9 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:23.246598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d733-176e-46e5-9792-3228213d22b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:23.247615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d733-176e-46e5-9792-3228213d22b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:23.247965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d733-176e-46e5-9792-3228213d22b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:23.248309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d733-176e-46e5-9792-3228213d22b3 admin admin] PATH_INFO: `/v3/projects/a60964f84d034bc7904923d042a9d2c5/users/97227fe021734fab9f78ffa05061b31e/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:23.267334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84d733-176e-46e5-9792-3228213d22b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60964f84d034bc7904923d042a9d2c5, user_id=97227fe021734fab9f78ffa05061b31e, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:23.271191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84d733-176e-46e5-9792-3228213d22b3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:23.296341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 908/1815] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:23 2022] PUT /identity/v3/projects/a60964f84d034bc7904923d042a9d2c5/users/97227fe021734fab9f78ffa05061b31e/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:23.303894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd7753-a448-4927-8f7a-47eb79b6ed9d admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:23.321864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd7753-a448-4927-8f7a-47eb79b6ed9d admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:23.406209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa15405-0320-4d2b-a9d9-25cf04d38929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:23.406908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa15405-0320-4d2b-a9d9-25cf04d38929 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:23.407193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa15405-0320-4d2b-a9d9-25cf04d38929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:23.407468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa15405-0320-4d2b-a9d9-25cf04d38929 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:23.408234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa15405-0320-4d2b-a9d9-25cf04d38929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:23.409920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa15405-0320-4d2b-a9d9-25cf04d38929 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:23.422404 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 908/1816] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:23.428803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d733-176e-46e5-9792-3228213d22b3 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:23.445750 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d733-176e-46e5-9792-3228213d22b3 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:23.451776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3412d44-fefd-4094-92d3-7a269b89d715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:23.452825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412d44-fefd-4094-92d3-7a269b89d715 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:23.453199 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412d44-fefd-4094-92d3-7a269b89d715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:23.453564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412d44-fefd-4094-92d3-7a269b89d715 admin admin] PATH_INFO: `/v3/projects/a60964f84d034bc7904923d042a9d2c5/users/97227fe021734fab9f78ffa05061b31e/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:23.456027 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3412d44-fefd-4094-92d3-7a269b89d715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60964f84d034bc7904923d042a9d2c5, user_id=97227fe021734fab9f78ffa05061b31e, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:23.458943 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3412d44-fefd-4094-92d3-7a269b89d715 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:23.472645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 909/1817] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:23 2022] PUT /identity/v3/projects/a60964f84d034bc7904923d042a9d2c5/users/97227fe021734fab9f78ffa05061b31e/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:23.484110 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2c4f-f3bb-4f04-84e7-0f0e863ebbd1 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:23.484404 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2c4f-f3bb-4f04-84e7-0f0e863ebbd1 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:23.484684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2c4f-f3bb-4f04-84e7-0f0e863ebbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:23.516719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-150a2c4f-f3bb-4f04-84e7-0f0e863ebbd1 None None] MFA Rules not processed for user `97227fe021734fab9f78ffa05061b31e`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:23.517972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-150a2c4f-f3bb-4f04-84e7-0f0e863ebbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:23.613993 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 909/1818] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:23.630859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3412d44-fefd-4094-92d3-7a269b89d715 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:23.633259 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d3412d44-fefd-4094-92d3-7a269b89d715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:23.747415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3412d44-fefd-4094-92d3-7a269b89d715 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:23.752364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4b156-55fa-47e6-93db-6d515518dfcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:23.753244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4b156-55fa-47e6-93db-6d515518dfcf service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:23.753703 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4b156-55fa-47e6-93db-6d515518dfcf service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:23.754270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4b156-55fa-47e6-93db-6d515518dfcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:23.766014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4b156-55fa-47e6-93db-6d515518dfcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:23.767506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4b156-55fa-47e6-93db-6d515518dfcf service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:23.779115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 910/1819] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:24.042668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2c4f-f3bb-4f04-84e7-0f0e863ebbd1 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:24.056951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2c4f-f3bb-4f04-84e7-0f0e863ebbd1 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:24.061452 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bc85c-02a6-46f2-af38-45007344cdb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:24.062158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bc85c-02a6-46f2-af38-45007344cdb7 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:24.062441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bc85c-02a6-46f2-af38-45007344cdb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:24.062718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bc85c-02a6-46f2-af38-45007344cdb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:24.142210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bc85c-02a6-46f2-af38-45007344cdb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:24.143947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bc85c-02a6-46f2-af38-45007344cdb7 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:24.156760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 910/1820] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:24.559438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4b156-55fa-47e6-93db-6d515518dfcf service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:24.648373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4b156-55fa-47e6-93db-6d515518dfcf service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:24.653920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:24.654859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:24.655128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:24.655422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] PATH_INFO: `/v3/users/ceb2013c7d114c7dae4a17c4a3754293` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:24.656767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb2013c7d114c7dae4a17c4a3754293)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:24.658827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:24.715460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb2013c7d114c7dae4a17c4a3754293'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:24.716166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb2013c7d114c7dae4a17c4a3754293'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:24.716840 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb2013c7d114c7dae4a17c4a3754293'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:24.727524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb2013c7d114c7dae4a17c4a3754293'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:24.736749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb2013c7d114c7dae4a17c4a3754293'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:24.763999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 911/1821] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:24 2022] DELETE /identity/v3/users/ceb2013c7d114c7dae4a17c4a3754293 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:24.771030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc433a5-819e-4588-8e9f-ab9ccfc34804 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:24.771790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc433a5-819e-4588-8e9f-ab9ccfc34804 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:24.772041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc433a5-819e-4588-8e9f-ab9ccfc34804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:24.808291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4bc433a5-819e-4588-8e9f-ab9ccfc34804 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:24.810679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4bc433a5-819e-4588-8e9f-ab9ccfc34804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:24.937346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 911/1822] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:24.947589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:24.950000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:25.038821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d94b9f-169e-4658-8db9-f6aa8e781f3e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:25.042999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14607bac-ef2e-4952-a027-20ee3abb98ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:25.043776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14607bac-ef2e-4952-a027-20ee3abb98ab service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:25.044118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14607bac-ef2e-4952-a027-20ee3abb98ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:25.044472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14607bac-ef2e-4952-a027-20ee3abb98ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:25.055628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14607bac-ef2e-4952-a027-20ee3abb98ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:25.057198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14607bac-ef2e-4952-a027-20ee3abb98ab service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:25.070283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 912/1823] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:25.430437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc433a5-819e-4588-8e9f-ab9ccfc34804 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:25.433629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4bc433a5-819e-4588-8e9f-ab9ccfc34804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:25.452353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc433a5-819e-4588-8e9f-ab9ccfc34804 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:25.460039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:25.461166 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:25.461435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:25.462556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] PATH_INFO: `/v3/projects/019be2d78fbd4f26b7d8484269f50a66` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:25.465360 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=019be2d78fbd4f26b7d8484269f50a66)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:25.468346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:25.536548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019be2d78fbd4f26b7d8484269f50a66', 'request_id': 'req-226bc671-cd90-43aa-8b09-6c95efe9f8d3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.543524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019be2d78fbd4f26b7d8484269f50a66', 'request_id': 'req-226bc671-cd90-43aa-8b09-6c95efe9f8d3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.552587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019be2d78fbd4f26b7d8484269f50a66', 'request_id': 'req-226bc671-cd90-43aa-8b09-6c95efe9f8d3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.568920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] The token cache is being invalidate because project 019be2d78fbd4f26b7d8484269f50a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:25.569236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.569922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.571558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 912/1824] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:25 2022] DELETE /identity/v3/projects/019be2d78fbd4f26b7d8484269f50a66 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:25.577083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14607bac-ef2e-4952-a027-20ee3abb98ab service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:25.593452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14607bac-ef2e-4952-a027-20ee3abb98ab service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:25.673418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:25.675042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:25.675540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:25.676050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] PATH_INFO: `/v3/users/97227fe021734fab9f78ffa05061b31e` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:25.678521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97227fe021734fab9f78ffa05061b31e)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:25.680972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:25.745925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97227fe021734fab9f78ffa05061b31e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.747007 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97227fe021734fab9f78ffa05061b31e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.748154 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97227fe021734fab9f78ffa05061b31e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.759193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97227fe021734fab9f78ffa05061b31e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.768097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-538ed80b-05c6-44ff-b34c-b59f37627e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97227fe021734fab9f78ffa05061b31e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:25.790245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 913/1825] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:25 2022] DELETE /identity/v3/users/97227fe021734fab9f78ffa05061b31e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:26.142243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:26.144456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:26.167937 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bc671-cd90-43aa-8b09-6c95efe9f8d3 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:26.281383 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:26.282445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:26.282733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:26.283018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] PATH_INFO: `/v3/projects/a60964f84d034bc7904923d042a9d2c5` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:26.285155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a60964f84d034bc7904923d042a9d2c5)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:26.287444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:26.362543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a60964f84d034bc7904923d042a9d2c5', 'request_id': 'req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:26.368828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a60964f84d034bc7904923d042a9d2c5', 'request_id': 'req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:26.379988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a60964f84d034bc7904923d042a9d2c5', 'request_id': 'req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:26.396546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] The token cache is being invalidate because project a60964f84d034bc7904923d042a9d2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:26.397038 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:26.397986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-adca3e17-baee-4be7-a3e2-fe0ad6d922f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:26.403672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 913/1826] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:26 2022] DELETE /identity/v3/projects/a60964f84d034bc7904923d042a9d2c5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:26.405468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e75c4-8468-4a70-abd4-8eb950f7bf05 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:26.406225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e75c4-8468-4a70-abd4-8eb950f7bf05 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:26.406225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e75c4-8468-4a70-abd4-8eb950f7bf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:26.427036 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8d0e75c4-8468-4a70-abd4-8eb950f7bf05 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:26.428682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8d0e75c4-8468-4a70-abd4-8eb950f7bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:26.542117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 914/1827] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:26.551753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a446-57ec-45be-a77b-08ec8cbe42bc None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:26.552050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a446-57ec-45be-a77b-08ec8cbe42bc None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:26.552345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a446-57ec-45be-a77b-08ec8cbe42bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:26.585812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-33c0a446-57ec-45be-a77b-08ec8cbe42bc None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:26.589216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-33c0a446-57ec-45be-a77b-08ec8cbe42bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:26.607246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 914/1828] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:26.611633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e75c4-8468-4a70-abd4-8eb950f7bf05 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:26.630088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e75c4-8468-4a70-abd4-8eb950f7bf05 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:26.638460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d661cc-d8f6-4852-819f-456b7463ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:26.640078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d661cc-d8f6-4852-819f-456b7463ab31 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:26.640310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d661cc-d8f6-4852-819f-456b7463ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:26.642357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d661cc-d8f6-4852-819f-456b7463ab31 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:26.644348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d661cc-d8f6-4852-819f-456b7463ab31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:26.644910 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d661cc-d8f6-4852-819f-456b7463ab31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:26.649599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d661cc-d8f6-4852-819f-456b7463ab31 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:26.683382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 915/1829] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:54:26.688254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0a446-57ec-45be-a77b-08ec8cbe42bc None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:26.706653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0a446-57ec-45be-a77b-08ec8cbe42bc None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:26.715309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b3bd6-f4f7-4255-9408-810d861a2133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:26.716476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b3bd6-f4f7-4255-9408-810d861a2133 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:26.716962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b3bd6-f4f7-4255-9408-810d861a2133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:26.717442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b3bd6-f4f7-4255-9408-810d861a2133 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:26.719081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b3bd6-f4f7-4255-9408-810d861a2133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:26.722986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b3bd6-f4f7-4255-9408-810d861a2133 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:26.769980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 915/1830] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:26 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:26.772092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d661cc-d8f6-4852-819f-456b7463ab31 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:26.790326 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d661cc-d8f6-4852-819f-456b7463ab31 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:26.922191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a83bd8-419f-4f40-979c-e0f939f15ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:26.923253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83bd8-419f-4f40-979c-e0f939f15ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:26.924778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83bd8-419f-4f40-979c-e0f939f15ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:26.925475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83bd8-419f-4f40-979c-e0f939f15ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:26.926619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a83bd8-419f-4f40-979c-e0f939f15ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:26.928848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a83bd8-419f-4f40-979c-e0f939f15ef6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:26.967797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 916/1831] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:26 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:26.969442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b3bd6-f4f7-4255-9408-810d861a2133 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:26.987367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b3bd6-f4f7-4255-9408-810d861a2133 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:26.994655 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec3a55-46c5-417f-bedd-494247b8aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:26.995847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec3a55-46c5-417f-bedd-494247b8aad0 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:26.995847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec3a55-46c5-417f-bedd-494247b8aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:26.996111 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec3a55-46c5-417f-bedd-494247b8aad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:26.997133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec3a55-46c5-417f-bedd-494247b8aad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:26.999506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec3a55-46c5-417f-bedd-494247b8aad0 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:27.016919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 916/1832] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:27.022702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a83bd8-419f-4f40-979c-e0f939f15ef6 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:27.033715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a83bd8-419f-4f40-979c-e0f939f15ef6 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:27.040115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf4b2-41ef-4e43-af12-a0a1384bae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:27.040799 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf4b2-41ef-4e43-af12-a0a1384bae33 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:27.041400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf4b2-41ef-4e43-af12-a0a1384bae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:27.041674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf4b2-41ef-4e43-af12-a0a1384bae33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:27.042715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf4b2-41ef-4e43-af12-a0a1384bae33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:27.044368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf4b2-41ef-4e43-af12-a0a1384bae33 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:27.066671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 917/1833] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:27.071267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec3a55-46c5-417f-bedd-494247b8aad0 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:27.082434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec3a55-46c5-417f-bedd-494247b8aad0 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:27.087426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414691d2-0443-447a-93fb-c58de615f5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:27.088475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414691d2-0443-447a-93fb-c58de615f5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:27.088762 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414691d2-0443-447a-93fb-c58de615f5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:27.089037 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414691d2-0443-447a-93fb-c58de615f5ad admin admin] PATH_INFO: `/v3/projects/9183f2950cf046c6a70d3ec4a95cb6af/users/1c13f0c056f94234b44e981d9e2caf60/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:27.106587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414691d2-0443-447a-93fb-c58de615f5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9183f2950cf046c6a70d3ec4a95cb6af, user_id=1c13f0c056f94234b44e981d9e2caf60, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:27.109282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414691d2-0443-447a-93fb-c58de615f5ad admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:27.127603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 917/1834] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:27 2022] PUT /identity/v3/projects/9183f2950cf046c6a70d3ec4a95cb6af/users/1c13f0c056f94234b44e981d9e2caf60/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:27.144006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6748-591b-4fde-82b8-11ef1d77d135 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:27.144462 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6748-591b-4fde-82b8-11ef1d77d135 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:27.144847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e6748-591b-4fde-82b8-11ef1d77d135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:27.177645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4b9e6748-591b-4fde-82b8-11ef1d77d135 None None] MFA Rules not processed for user `1c13f0c056f94234b44e981d9e2caf60`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:27.179108 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4b9e6748-591b-4fde-82b8-11ef1d77d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:27.277050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 918/1835] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:27.296663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414691d2-0443-447a-93fb-c58de615f5ad admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:27.299528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-414691d2-0443-447a-93fb-c58de615f5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:27.409050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414691d2-0443-447a-93fb-c58de615f5ad admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:27.415446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2d1c-f736-44a4-854a-a73e150b3b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:27.417461 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2d1c-f736-44a4-854a-a73e150b3b6d service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:27.417834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2d1c-f736-44a4-854a-a73e150b3b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:27.418330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2d1c-f736-44a4-854a-a73e150b3b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:27.435952 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af2d1c-f736-44a4-854a-a73e150b3b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:27.438581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af2d1c-f736-44a4-854a-a73e150b3b6d service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:27.457063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 918/1836] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:27.487707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e6748-591b-4fde-82b8-11ef1d77d135 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:27.608992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e6748-591b-4fde-82b8-11ef1d77d135 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:27.616602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:27.618051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:27.618526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:27.618970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] PATH_INFO: `/v3/users/1c13f0c056f94234b44e981d9e2caf60` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:27.621171 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c13f0c056f94234b44e981d9e2caf60)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:27.623663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:27.687544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c13f0c056f94234b44e981d9e2caf60'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:27.688261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c13f0c056f94234b44e981d9e2caf60'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:27.688899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c13f0c056f94234b44e981d9e2caf60'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:27.699183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c13f0c056f94234b44e981d9e2caf60'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:27.715840 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c13f0c056f94234b44e981d9e2caf60'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:27.746100 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 919/1837] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:27 2022] DELETE /identity/v3/users/1c13f0c056f94234b44e981d9e2caf60 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:27.752784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7195b3c-4573-4906-a56d-5e7d43e473d2 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:27.753308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7195b3c-4573-4906-a56d-5e7d43e473d2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:27.753782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7195b3c-4573-4906-a56d-5e7d43e473d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:27.781025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c7195b3c-4573-4906-a56d-5e7d43e473d2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:27.782938 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c7195b3c-4573-4906-a56d-5e7d43e473d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:27.868951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 919/1838] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:27.882103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:27.883893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:27.988949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42267a6f-89da-445e-ba51-5ae8f25ae9be admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:27.995720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8958d75-5756-4529-938b-b5b723982a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:27.996829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8958d75-5756-4529-938b-b5b723982a3b service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:27.997267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8958d75-5756-4529-938b-b5b723982a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:27.997907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8958d75-5756-4529-938b-b5b723982a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:28.014678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8958d75-5756-4529-938b-b5b723982a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:28.016734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8958d75-5756-4529-938b-b5b723982a3b service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:28.030386 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 920/1839] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:28.216741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7195b3c-4573-4906-a56d-5e7d43e473d2 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:28.219319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c7195b3c-4573-4906-a56d-5e7d43e473d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:28.235486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7195b3c-4573-4906-a56d-5e7d43e473d2 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:28.243671 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:28.244543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:28.244847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:28.245379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] PATH_INFO: `/v3/users/5cec9e79a93a4bc28e21a931900eb18d` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:28.247597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cec9e79a93a4bc28e21a931900eb18d)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:28.250090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:28.345353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cec9e79a93a4bc28e21a931900eb18d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.398275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cec9e79a93a4bc28e21a931900eb18d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.404791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cec9e79a93a4bc28e21a931900eb18d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.405986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cec9e79a93a4bc28e21a931900eb18d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.420370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cec9e79a93a4bc28e21a931900eb18d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.428997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 920/1840] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:28 2022] DELETE /identity/v3/users/5cec9e79a93a4bc28e21a931900eb18d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:28.437190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8413e-e633-4957-b46c-f001e4d9ebb2 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:28.437591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8413e-e633-4957-b46c-f001e4d9ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:28.438134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8413e-e633-4957-b46c-f001e4d9ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:28.464620 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4bc8413e-e633-4957-b46c-f001e4d9ebb2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:28.466087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4bc8413e-e633-4957-b46c-f001e4d9ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:28.534584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 921/1841] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:28.544880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:28.546721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:28.625372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75cd84-681a-455c-8097-3b23022aff32 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:28.629710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc74f9-2256-4053-91fb-3cf5a904a52b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:28.630555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc74f9-2256-4053-91fb-3cf5a904a52b service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:28.630787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc74f9-2256-4053-91fb-3cf5a904a52b service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:28.631034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc74f9-2256-4053-91fb-3cf5a904a52b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:28.645791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc74f9-2256-4053-91fb-3cf5a904a52b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:28.646088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8413e-e633-4957-b46c-f001e4d9ebb2 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:28.648522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc74f9-2256-4053-91fb-3cf5a904a52b service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:28.648884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4bc8413e-e633-4957-b46c-f001e4d9ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:28.670093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8413e-e633-4957-b46c-f001e4d9ebb2 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:28.677464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 921/1842] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:28.678855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:28.680576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:28.681238 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:28.681814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] PATH_INFO: `/v3/projects/9183f2950cf046c6a70d3ec4a95cb6af` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:28.685498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9183f2950cf046c6a70d3ec4a95cb6af)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:28.690818 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:28.763035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9183f2950cf046c6a70d3ec4a95cb6af', 'request_id': 'req-d66b323f-14e4-436b-9553-f04a62a98e6a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.770671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9183f2950cf046c6a70d3ec4a95cb6af', 'request_id': 'req-d66b323f-14e4-436b-9553-f04a62a98e6a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.777602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9183f2950cf046c6a70d3ec4a95cb6af', 'request_id': 'req-d66b323f-14e4-436b-9553-f04a62a98e6a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.795363 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] The token cache is being invalidate because project 9183f2950cf046c6a70d3ec4a95cb6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:28.795887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.796647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d66b323f-14e4-436b-9553-f04a62a98e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:28.799272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 922/1843] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:28 2022] DELETE /identity/v3/projects/9183f2950cf046c6a70d3ec4a95cb6af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:28.804155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4976201-9609-486b-ae31-6d427022a04e None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:28.804441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4976201-9609-486b-ae31-6d427022a04e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:28.804716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4976201-9609-486b-ae31-6d427022a04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:28.825666 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e4976201-9609-486b-ae31-6d427022a04e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:28.827059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e4976201-9609-486b-ae31-6d427022a04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:28.905019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 922/1844] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:28.912974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9402b-4b89-4512-b6af-518d514468d9 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:28.913263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9402b-4b89-4512-b6af-518d514468d9 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:28.913545 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9402b-4b89-4512-b6af-518d514468d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:28.934901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-e5d9402b-4b89-4512-b6af-518d514468d9 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:28.936133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e5d9402b-4b89-4512-b6af-518d514468d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:28.945836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 923/1845] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:28.952179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4976201-9609-486b-ae31-6d427022a04e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:28.965070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4976201-9609-486b-ae31-6d427022a04e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:28.971283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073a9e3-1bba-4c51-9bd8-116b36a2af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:28.971970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073a9e3-1bba-4c51-9bd8-116b36a2af04 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:28.972256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073a9e3-1bba-4c51-9bd8-116b36a2af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:28.972526 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073a9e3-1bba-4c51-9bd8-116b36a2af04 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:28.973270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073a9e3-1bba-4c51-9bd8-116b36a2af04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:28.973786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073a9e3-1bba-4c51-9bd8-116b36a2af04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:28.975608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073a9e3-1bba-4c51-9bd8-116b36a2af04 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:28.989922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 923/1846] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:54:28.996966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9402b-4b89-4512-b6af-518d514468d9 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:29.013556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9402b-4b89-4512-b6af-518d514468d9 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:29.022234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f242f-ad74-474a-9e5e-6613acb6ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:29.023805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f242f-ad74-474a-9e5e-6613acb6ea4e admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:29.024324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f242f-ad74-474a-9e5e-6613acb6ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:29.024766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f242f-ad74-474a-9e5e-6613acb6ea4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:29.026157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f242f-ad74-474a-9e5e-6613acb6ea4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:29.029920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f242f-ad74-474a-9e5e-6613acb6ea4e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:29.067605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 924/1847] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:28 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:29.072039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073a9e3-1bba-4c51-9bd8-116b36a2af04 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:29.083095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073a9e3-1bba-4c51-9bd8-116b36a2af04 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:29.136491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f242f-ad74-474a-9e5e-6613acb6ea4e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:29.138557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5e7f242f-ad74-474a-9e5e-6613acb6ea4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:29.208245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52329af-cf13-4779-b4ba-95be020db6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:29.210014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52329af-cf13-4779-b4ba-95be020db6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:29.210703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52329af-cf13-4779-b4ba-95be020db6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:29.211197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52329af-cf13-4779-b4ba-95be020db6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:29.214141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52329af-cf13-4779-b4ba-95be020db6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:29.219683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52329af-cf13-4779-b4ba-95be020db6d9 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:29.226067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f242f-ad74-474a-9e5e-6613acb6ea4e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:29.232328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:29.233483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:29.233818 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:29.234203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] PATH_INFO: `/v3/projects/e1122bae17e04e23bc38093245e8821b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:29.235800 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1122bae17e04e23bc38093245e8821b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:29.238400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:29.249816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 924/1848] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:29 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:29.256278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52329af-cf13-4779-b4ba-95be020db6d9 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:29.272569 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52329af-cf13-4779-b4ba-95be020db6d9 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:29.280459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f0fd6-7425-4ddc-a5b4-34f15f36a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:29.281304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f0fd6-7425-4ddc-a5b4-34f15f36a37a admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:29.281772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f0fd6-7425-4ddc-a5b4-34f15f36a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:29.282203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f0fd6-7425-4ddc-a5b4-34f15f36a37a admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:29.283126 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f0fd6-7425-4ddc-a5b4-34f15f36a37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:29.285995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f0fd6-7425-4ddc-a5b4-34f15f36a37a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:29.300919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 925/1849] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:29.307549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f0fd6-7425-4ddc-a5b4-34f15f36a37a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:29.313776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1122bae17e04e23bc38093245e8821b', 'request_id': 'req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.322176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1122bae17e04e23bc38093245e8821b', 'request_id': 'req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.324568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f0fd6-7425-4ddc-a5b4-34f15f36a37a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:29.333073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1122bae17e04e23bc38093245e8821b', 'request_id': 'req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.353106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] The token cache is being invalidate because project e1122bae17e04e23bc38093245e8821b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:29.353609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.354704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.358012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 925/1850] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:29 2022] DELETE /identity/v3/projects/e1122bae17e04e23bc38093245e8821b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:29.362673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:29.364860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:29.493894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b777-6254-4e58-8734-e859967999e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:29.496245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b777-6254-4e58-8734-e859967999e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:29.497018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b777-6254-4e58-8734-e859967999e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:29.497510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b777-6254-4e58-8734-e859967999e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:29.498970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875b777-6254-4e58-8734-e859967999e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:29.503812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875b777-6254-4e58-8734-e859967999e0 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:29.526453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 926/1851] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:29.532792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b777-6254-4e58-8734-e859967999e0 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:29.534566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfb5ba-c9ae-40cc-8ce6-93d90de85940 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:29.538287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7875b777-6254-4e58-8734-e859967999e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:29.548565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:29.549586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:29.549961 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:29.550323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] PATH_INFO: `/v3/users/29cf69f4592e4c7c8c7059eb36293add` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:29.551873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cf69f4592e4c7c8c7059eb36293add)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:29.554699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:29.567485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b777-6254-4e58-8734-e859967999e0 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:29.576081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c65c45-0f62-4b90-96f4-4a2174674c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:29.578378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65c45-0f62-4b90-96f4-4a2174674c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:29.579455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65c45-0f62-4b90-96f4-4a2174674c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:29.580423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65c45-0f62-4b90-96f4-4a2174674c98 admin admin] PATH_INFO: `/v3/projects/51123662771a4e8686781aed7551ed0b/users/6e8e42549ecb47aea2684767019f504b/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:29.621492 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c65c45-0f62-4b90-96f4-4a2174674c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51123662771a4e8686781aed7551ed0b, user_id=6e8e42549ecb47aea2684767019f504b, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:29.624621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c65c45-0f62-4b90-96f4-4a2174674c98 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:29.655426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 927/1852] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:29 2022] PUT /identity/v3/projects/51123662771a4e8686781aed7551ed0b/users/6e8e42549ecb47aea2684767019f504b/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:29.658231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cf69f4592e4c7c8c7059eb36293add'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.659990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cf69f4592e4c7c8c7059eb36293add'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.660837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cf69f4592e4c7c8c7059eb36293add'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.670689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424eca6-b89e-48db-9789-2de61dead924 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:29.671229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424eca6-b89e-48db-9789-2de61dead924 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:29.671742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424eca6-b89e-48db-9789-2de61dead924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:29.673227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cf69f4592e4c7c8c7059eb36293add'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.685455 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cf69f4592e4c7c8c7059eb36293add'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:29.711189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-b424eca6-b89e-48db-9789-2de61dead924 None None] MFA Rules not processed for user `6e8e42549ecb47aea2684767019f504b`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:29.713300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b424eca6-b89e-48db-9789-2de61dead924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:29.719272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 926/1853] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:29 2022] DELETE /identity/v3/users/29cf69f4592e4c7c8c7059eb36293add => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:29.832901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 928/1854] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:29.842054 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:29.844009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:29.943758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd051a-ebb8-4aec-b300-bdae0f17da1c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:29.956110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1517ed-034d-4026-a320-3c1ba0e9b746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:29.957675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1517ed-034d-4026-a320-3c1ba0e9b746 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:29.958439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1517ed-034d-4026-a320-3c1ba0e9b746 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:29.959373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1517ed-034d-4026-a320-3c1ba0e9b746 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:29.961534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1517ed-034d-4026-a320-3c1ba0e9b746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:29.966387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1517ed-034d-4026-a320-3c1ba0e9b746 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.023724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 927/1855] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:29 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:30.029144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424eca6-b89e-48db-9789-2de61dead924 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.050149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424eca6-b89e-48db-9789-2de61dead924 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.105931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1517ed-034d-4026-a320-3c1ba0e9b746 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.108994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3b1517ed-034d-4026-a320-3c1ba0e9b746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:30.163747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69869010-a072-418d-8ad7-703f30281c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.165244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69869010-a072-418d-8ad7-703f30281c3b admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.165515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69869010-a072-418d-8ad7-703f30281c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.165979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69869010-a072-418d-8ad7-703f30281c3b admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.167363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69869010-a072-418d-8ad7-703f30281c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.170684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69869010-a072-418d-8ad7-703f30281c3b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.201395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 929/1856] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:30 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:30.206039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69869010-a072-418d-8ad7-703f30281c3b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.216107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1517ed-034d-4026-a320-3c1ba0e9b746 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.222207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.223331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.223722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.224068 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69869010-a072-418d-8ad7-703f30281c3b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.224235 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] PATH_INFO: `/v3/projects/3bbfb336f0c84e909f42cb9ca935f3a7` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.225633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbfb336f0c84e909f42cb9ca935f3a7)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.227830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.235407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213ed71-b018-4d09-8c40-16aa78d66a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.236256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ed71-b018-4d09-8c40-16aa78d66a27 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.236976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ed71-b018-4d09-8c40-16aa78d66a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.237447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ed71-b018-4d09-8c40-16aa78d66a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.239501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213ed71-b018-4d09-8c40-16aa78d66a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.242992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213ed71-b018-4d09-8c40-16aa78d66a27 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.264567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 930/1857] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:54:30.269036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213ed71-b018-4d09-8c40-16aa78d66a27 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.290342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213ed71-b018-4d09-8c40-16aa78d66a27 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.294709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbfb336f0c84e909f42cb9ca935f3a7', 'request_id': 'req-3f333134-accf-4739-b215-2249ab90b506'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:30.304966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbfb336f0c84e909f42cb9ca935f3a7', 'request_id': 'req-3f333134-accf-4739-b215-2249ab90b506'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:30.312296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbfb336f0c84e909f42cb9ca935f3a7', 'request_id': 'req-3f333134-accf-4739-b215-2249ab90b506'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:30.334449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] The token cache is being invalidate because project 3bbfb336f0c84e909f42cb9ca935f3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:30.335476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:30.336811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3f333134-accf-4739-b215-2249ab90b506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:30.341364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 928/1858] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:30 2022] DELETE /identity/v3/projects/3bbfb336f0c84e909f42cb9ca935f3a7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:30.350429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad3a31-911f-4295-ad2c-498026ff21c9 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.350429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad3a31-911f-4295-ad2c-498026ff21c9 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.350429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad3a31-911f-4295-ad2c-498026ff21c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.373565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-49ad3a31-911f-4295-ad2c-498026ff21c9 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:30.375649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-49ad3a31-911f-4295-ad2c-498026ff21c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:30.408926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e434df7-fa11-48fc-94de-410615641561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.410955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e434df7-fa11-48fc-94de-410615641561 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.411462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e434df7-fa11-48fc-94de-410615641561 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.412852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e434df7-fa11-48fc-94de-410615641561 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.414372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e434df7-fa11-48fc-94de-410615641561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.419508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e434df7-fa11-48fc-94de-410615641561 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.450107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 931/1859] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:54:30.450107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e434df7-fa11-48fc-94de-410615641561 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.450362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0e434df7-fa11-48fc-94de-410615641561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:30.471077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 929/1860] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:30.473996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e434df7-fa11-48fc-94de-410615641561 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.475772 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56db436-71e0-4bf1-b629-a3d09ee9dd3f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.476139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56db436-71e0-4bf1-b629-a3d09ee9dd3f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.476808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56db436-71e0-4bf1-b629-a3d09ee9dd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.481979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20e316-74b0-4b55-99b6-c98c15a5de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.482905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20e316-74b0-4b55-99b6-c98c15a5de86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.483340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20e316-74b0-4b55-99b6-c98c15a5de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.483512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20e316-74b0-4b55-99b6-c98c15a5de86 admin admin] PATH_INFO: `/v3/projects/2ce3d2e4acc54046912aff5be9a986ae/users/6706fbb67f08421881ac81d806d55183/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.501681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20e316-74b0-4b55-99b6-c98c15a5de86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce3d2e4acc54046912aff5be9a986ae, user_id=6706fbb67f08421881ac81d806d55183, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.504520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20e316-74b0-4b55-99b6-c98c15a5de86 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.506937 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c56db436-71e0-4bf1-b629-a3d09ee9dd3f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:30.509018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c56db436-71e0-4bf1-b629-a3d09ee9dd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:30.520097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 932/1861] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:30 2022] PUT /identity/v3/projects/2ce3d2e4acc54046912aff5be9a986ae/users/6706fbb67f08421881ac81d806d55183/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:30.532103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c22e7d-f05d-4f73-8d7b-7623b3027b4b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.532617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c22e7d-f05d-4f73-8d7b-7623b3027b4b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.533083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c22e7d-f05d-4f73-8d7b-7623b3027b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.572304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e3c22e7d-f05d-4f73-8d7b-7623b3027b4b None None] MFA Rules not processed for user `6706fbb67f08421881ac81d806d55183`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:30.574619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e3c22e7d-f05d-4f73-8d7b-7623b3027b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:30.588129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 930/1862] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:30.593778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56db436-71e0-4bf1-b629-a3d09ee9dd3f None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.609726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56db436-71e0-4bf1-b629-a3d09ee9dd3f None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.619317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc3912-6b5c-41b6-8f0a-f16d5a514bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.620500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc3912-6b5c-41b6-8f0a-f16d5a514bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.621005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc3912-6b5c-41b6-8f0a-f16d5a514bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.621445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc3912-6b5c-41b6-8f0a-f16d5a514bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.623076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc3912-6b5c-41b6-8f0a-f16d5a514bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:30.623629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc3912-6b5c-41b6-8f0a-f16d5a514bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.626745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc3912-6b5c-41b6-8f0a-f16d5a514bf5 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.654530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 931/1863] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:54:30.656083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc3912-6b5c-41b6-8f0a-f16d5a514bf5 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.672235 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc3912-6b5c-41b6-8f0a-f16d5a514bf5 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.679946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5957b9-97c9-481c-9e0f-91df38b98fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.680741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5957b9-97c9-481c-9e0f-91df38b98fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.681126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5957b9-97c9-481c-9e0f-91df38b98fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.681503 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5957b9-97c9-481c-9e0f-91df38b98fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.682578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5957b9-97c9-481c-9e0f-91df38b98fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.685095 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5957b9-97c9-481c-9e0f-91df38b98fb0 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.687035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 933/1864] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:30.688476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c22e7d-f05d-4f73-8d7b-7623b3027b4b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.707614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c22e7d-f05d-4f73-8d7b-7623b3027b4b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.719565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad0df6-f7b1-44e4-a502-165ae5aa953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.719565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad0df6-f7b1-44e4-a502-165ae5aa953f admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.719565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad0df6-f7b1-44e4-a502-165ae5aa953f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.719565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad0df6-f7b1-44e4-a502-165ae5aa953f admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.720274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad0df6-f7b1-44e4-a502-165ae5aa953f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.720274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad0df6-f7b1-44e4-a502-165ae5aa953f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.737030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 932/1865] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:30 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:30.743268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5957b9-97c9-481c-9e0f-91df38b98fb0 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.758207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 934/1866] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:30 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:30.764300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad0df6-f7b1-44e4-a502-165ae5aa953f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.827511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5957b9-97c9-481c-9e0f-91df38b98fb0 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.896677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c719bc-a095-4ca6-b182-2c900ba119a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.897380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c719bc-a095-4ca6-b182-2c900ba119a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.897662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c719bc-a095-4ca6-b182-2c900ba119a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.897964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c719bc-a095-4ca6-b182-2c900ba119a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.898699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c719bc-a095-4ca6-b182-2c900ba119a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.901838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c719bc-a095-4ca6-b182-2c900ba119a4 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.915656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad0df6-f7b1-44e4-a502-165ae5aa953f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.928817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 933/1867] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:30 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:30.930038 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9560be6-2217-43f7-9a05-b1dc57417fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.931425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9560be6-2217-43f7-9a05-b1dc57417fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.933152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c719bc-a095-4ca6-b182-2c900ba119a4 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.933412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9560be6-2217-43f7-9a05-b1dc57417fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.934090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9560be6-2217-43f7-9a05-b1dc57417fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.935486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9560be6-2217-43f7-9a05-b1dc57417fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.939899 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9560be6-2217-43f7-9a05-b1dc57417fb2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.944747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c719bc-a095-4ca6-b182-2c900ba119a4 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.950066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d90db9-286c-46cb-8a74-203b2f87c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.950762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d90db9-286c-46cb-8a74-203b2f87c0fd admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.951045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d90db9-286c-46cb-8a74-203b2f87c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.951322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d90db9-286c-46cb-8a74-203b2f87c0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.952066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d90db9-286c-46cb-8a74-203b2f87c0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.953905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d90db9-286c-46cb-8a74-203b2f87c0fd admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.970322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 934/1868] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:30.971425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d90db9-286c-46cb-8a74-203b2f87c0fd admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:30.984168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d90db9-286c-46cb-8a74-203b2f87c0fd admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:30.992672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 935/1869] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:30 2022] POST /identity/v3/users => generated 299 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:30.992902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f1b19-fa80-4746-9d8d-436e4813a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:30.992902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f1b19-fa80-4746-9d8d-436e4813a598 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:30.992902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f1b19-fa80-4746-9d8d-436e4813a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:30.992902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f1b19-fa80-4746-9d8d-436e4813a598 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:30.993389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f1b19-fa80-4746-9d8d-436e4813a598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:30.994141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f1b19-fa80-4746-9d8d-436e4813a598 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:30.994795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9560be6-2217-43f7-9a05-b1dc57417fb2 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.010912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 935/1870] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:31.012047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f1b19-fa80-4746-9d8d-436e4813a598 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.018296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9560be6-2217-43f7-9a05-b1dc57417fb2 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.023863 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f1b19-fa80-4746-9d8d-436e4813a598 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.025631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e627-368f-41e6-bdef-7c3f933ced72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.027301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e627-368f-41e6-bdef-7c3f933ced72 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.027945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e627-368f-41e6-bdef-7c3f933ced72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.028419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e627-368f-41e6-bdef-7c3f933ced72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.028960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b74619-4404-4b02-93b2-e4ac77b9b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.029253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394e627-368f-41e6-bdef-7c3f933ced72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.030027 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b74619-4404-4b02-93b2-e4ac77b9b7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.030310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b74619-4404-4b02-93b2-e4ac77b9b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.030589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b74619-4404-4b02-93b2-e4ac77b9b7fe admin admin] PATH_INFO: `/v3/projects/2e0f8774c0494e54b4b184b5c933ac07/users/951c59176f82489d93db5b74ab67ffdd/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.031094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394e627-368f-41e6-bdef-7c3f933ced72 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.042896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 936/1871] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:31.047147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e627-368f-41e6-bdef-7c3f933ced72 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.056312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b74619-4404-4b02-93b2-e4ac77b9b7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0f8774c0494e54b4b184b5c933ac07, user_id=951c59176f82489d93db5b74ab67ffdd, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.060005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e627-368f-41e6-bdef-7c3f933ced72 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.062414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b74619-4404-4b02-93b2-e4ac77b9b7fe admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.070299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a0abd-e182-4bc5-839a-a89cd1ae18b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.071924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a0abd-e182-4bc5-839a-a89cd1ae18b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.072520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a0abd-e182-4bc5-839a-a89cd1ae18b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.073106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a0abd-e182-4bc5-839a-a89cd1ae18b6 admin admin] PATH_INFO: `/v3/projects/61d2e5590f714430aba111b15d74493a/users/8647cf1491db4506b4d61efb6e714b1c/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.093418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 936/1872] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:31 2022] PUT /identity/v3/projects/2e0f8774c0494e54b4b184b5c933ac07/users/951c59176f82489d93db5b74ab67ffdd/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:31.096391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a0abd-e182-4bc5-839a-a89cd1ae18b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d2e5590f714430aba111b15d74493a, user_id=8647cf1491db4506b4d61efb6e714b1c, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.099792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a0abd-e182-4bc5-839a-a89cd1ae18b6 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.106709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13698ce0-610c-4a96-b660-2c819f9336b0 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.107234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13698ce0-610c-4a96-b660-2c819f9336b0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.107600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13698ce0-610c-4a96-b660-2c819f9336b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.117543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 937/1873] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:31 2022] PUT /identity/v3/projects/61d2e5590f714430aba111b15d74493a/users/8647cf1491db4506b4d61efb6e714b1c/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:31.122235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a0abd-e182-4bc5-839a-a89cd1ae18b6 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.137827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-13698ce0-610c-4a96-b660-2c819f9336b0 None None] MFA Rules not processed for user `951c59176f82489d93db5b74ab67ffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:31.139220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-13698ce0-610c-4a96-b660-2c819f9336b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:31.194175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a0abd-e182-4bc5-839a-a89cd1ae18b6 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.200471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fa02c-d207-4be3-a561-73abcc1dde8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.201162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fa02c-d207-4be3-a561-73abcc1dde8e admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.201441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fa02c-d207-4be3-a561-73abcc1dde8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.201719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fa02c-d207-4be3-a561-73abcc1dde8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.202490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fa02c-d207-4be3-a561-73abcc1dde8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.204148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fa02c-d207-4be3-a561-73abcc1dde8e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.217843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 938/1874] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:31.222347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fa02c-d207-4be3-a561-73abcc1dde8e admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.236871 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fa02c-d207-4be3-a561-73abcc1dde8e admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.242092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 937/1875] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:31.244481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3d97-7977-4f75-9514-a2a464313e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.245409 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3d97-7977-4f75-9514-a2a464313e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.245689 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3d97-7977-4f75-9514-a2a464313e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.245996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3d97-7977-4f75-9514-a2a464313e16 admin admin] PATH_INFO: `/v3/projects/61d2e5590f714430aba111b15d74493a/users/8647cf1491db4506b4d61efb6e714b1c/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.247009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13698ce0-610c-4a96-b660-2c819f9336b0 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.248175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3d97-7977-4f75-9514-a2a464313e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d2e5590f714430aba111b15d74493a, user_id=8647cf1491db4506b4d61efb6e714b1c, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.250948 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3d97-7977-4f75-9514-a2a464313e16 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.265444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 939/1876] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:31 2022] PUT /identity/v3/projects/61d2e5590f714430aba111b15d74493a/users/8647cf1491db4506b4d61efb6e714b1c/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:31.268881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13698ce0-610c-4a96-b660-2c819f9336b0 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.276731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae99c5-25b5-48ca-b0da-a55660737b72 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.278309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae99c5-25b5-48ca-b0da-a55660737b72 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.278309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae99c5-25b5-48ca-b0da-a55660737b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.308986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6aae99c5-25b5-48ca-b0da-a55660737b72 None None] MFA Rules not processed for user `8647cf1491db4506b4d61efb6e714b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:31.310467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6aae99c5-25b5-48ca-b0da-a55660737b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:31.367324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f88a12-32b9-4754-9839-4f4031700a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.368392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f88a12-32b9-4754-9839-4f4031700a57 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.368820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f88a12-32b9-4754-9839-4f4031700a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.369283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f88a12-32b9-4754-9839-4f4031700a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.370532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f88a12-32b9-4754-9839-4f4031700a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.374138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f88a12-32b9-4754-9839-4f4031700a57 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.385884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 940/1877] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:31.403593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae99c5-25b5-48ca-b0da-a55660737b72 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.405910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6aae99c5-25b5-48ca-b0da-a55660737b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:31.410095 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 938/1878] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:31 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:31.414364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f88a12-32b9-4754-9839-4f4031700a57 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.481190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae99c5-25b5-48ca-b0da-a55660737b72 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.520490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f88a12-32b9-4754-9839-4f4031700a57 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.529828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeda922-7dcf-4ac3-9b04-915cd58f4740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.534643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeda922-7dcf-4ac3-9b04-915cd58f4740 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.534940 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeda922-7dcf-4ac3-9b04-915cd58f4740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.535210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeda922-7dcf-4ac3-9b04-915cd58f4740 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.535998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeda922-7dcf-4ac3-9b04-915cd58f4740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.538072 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeda922-7dcf-4ac3-9b04-915cd58f4740 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.540273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7fc60-9f76-4c89-942e-4f0f00e4f35b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.541033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7fc60-9f76-4c89-942e-4f0f00e4f35b service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.541272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7fc60-9f76-4c89-942e-4f0f00e4f35b service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.542225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7fc60-9f76-4c89-942e-4f0f00e4f35b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.543982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e4c7fc60-9f76-4c89-942e-4f0f00e4f35b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:31.566614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 939/1879] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:31 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:31.571418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeda922-7dcf-4ac3-9b04-915cd58f4740 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.592656 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeda922-7dcf-4ac3-9b04-915cd58f4740 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.599307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a4270-6d51-4abd-ada2-f00060e98f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.599999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a4270-6d51-4abd-ada2-f00060e98f08 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.600417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a4270-6d51-4abd-ada2-f00060e98f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.601002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a4270-6d51-4abd-ada2-f00060e98f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.601769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a4270-6d51-4abd-ada2-f00060e98f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.603484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a4270-6d51-4abd-ada2-f00060e98f08 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.618013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 940/1880] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:54:31.623045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a4270-6d51-4abd-ada2-f00060e98f08 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.630442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7fc60-9f76-4c89-942e-4f0f00e4f35b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.633214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7fc60-9f76-4c89-942e-4f0f00e4f35b service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.633347 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a4270-6d51-4abd-ada2-f00060e98f08 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.638412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf8d21-2d38-4bf2-acac-0c247d779b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.639433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf8d21-2d38-4bf2-acac-0c247d779b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.639977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf8d21-2d38-4bf2-acac-0c247d779b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.640325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf8d21-2d38-4bf2-acac-0c247d779b7a admin admin] PATH_INFO: `/v3/projects/2c641290b9394863883eca89254b7636/users/13a128d862a74603a82d280be58b5e20/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.649279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 941/1881] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:31.660277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf8d21-2d38-4bf2-acac-0c247d779b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c641290b9394863883eca89254b7636, user_id=13a128d862a74603a82d280be58b5e20, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.665146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf8d21-2d38-4bf2-acac-0c247d779b7a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.689337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 941/1882] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:31 2022] PUT /identity/v3/projects/2c641290b9394863883eca89254b7636/users/13a128d862a74603a82d280be58b5e20/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:31.693549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7fc60-9f76-4c89-942e-4f0f00e4f35b service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.705485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7fc60-9f76-4c89-942e-4f0f00e4f35b service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.789105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0fadb-30ad-4882-beef-1e3c9300373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.790185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0fadb-30ad-4882-beef-1e3c9300373c admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.790576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0fadb-30ad-4882-beef-1e3c9300373c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.790914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0fadb-30ad-4882-beef-1e3c9300373c admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.792866 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0fadb-30ad-4882-beef-1e3c9300373c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.794794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0fadb-30ad-4882-beef-1e3c9300373c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.809182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 942/1883] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:54:31.814700 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf8d21-2d38-4bf2-acac-0c247d779b7a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:31.830739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf8d21-2d38-4bf2-acac-0c247d779b7a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:31.850442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fa027-e22b-440d-bbbc-0069e6809766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:31.851944 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fa027-e22b-440d-bbbc-0069e6809766 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.852468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fa027-e22b-440d-bbbc-0069e6809766 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.852967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fa027-e22b-440d-bbbc-0069e6809766 admin admin] PATH_INFO: `/v3/projects/2c641290b9394863883eca89254b7636/users/13a128d862a74603a82d280be58b5e20/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.857100 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fa027-e22b-440d-bbbc-0069e6809766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c641290b9394863883eca89254b7636, user_id=13a128d862a74603a82d280be58b5e20, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:31.860479 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fa027-e22b-440d-bbbc-0069e6809766 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:31.877569 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 942/1884] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:31 2022] PUT /identity/v3/projects/2c641290b9394863883eca89254b7636/users/13a128d862a74603a82d280be58b5e20/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:31.889196 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b980ff-4cb5-41a4-924c-1071a5f32cda None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:31.889727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b980ff-4cb5-41a4-924c-1071a5f32cda None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:31.890125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b980ff-4cb5-41a4-924c-1071a5f32cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:31.946406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d5b980ff-4cb5-41a4-924c-1071a5f32cda None None] MFA Rules not processed for user `13a128d862a74603a82d280be58b5e20`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:31.948201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d5b980ff-4cb5-41a4-924c-1071a5f32cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:32.049834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 943/1885] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:32.078592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fa027-e22b-440d-bbbc-0069e6809766 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:32.103228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9d2fa027-e22b-440d-bbbc-0069e6809766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:32.278504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fa027-e22b-440d-bbbc-0069e6809766 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:32.291526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294d3f7-4093-4601-a116-a32f17064f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:32.292648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294d3f7-4093-4601-a116-a32f17064f3d service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:32.292951 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294d3f7-4093-4601-a116-a32f17064f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:32.293247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294d3f7-4093-4601-a116-a32f17064f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:32.304148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294d3f7-4093-4601-a116-a32f17064f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:32.306389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294d3f7-4093-4601-a116-a32f17064f3d service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:32.319249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 943/1886] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:32.497707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b980ff-4cb5-41a4-924c-1071a5f32cda None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:32.516103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b980ff-4cb5-41a4-924c-1071a5f32cda None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:32.522929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f45c04-879a-46ff-9ad7-9ed41fe1ac2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:32.524152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f45c04-879a-46ff-9ad7-9ed41fe1ac2e service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:32.524947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f45c04-879a-46ff-9ad7-9ed41fe1ac2e service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:32.525889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f45c04-879a-46ff-9ad7-9ed41fe1ac2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:32.651092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f45c04-879a-46ff-9ad7-9ed41fe1ac2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:32.653052 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f45c04-879a-46ff-9ad7-9ed41fe1ac2e service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:32.664071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 944/1887] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:34.614219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294d3f7-4093-4601-a116-a32f17064f3d service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:34.635603 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294d3f7-4093-4601-a116-a32f17064f3d service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:34.642272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72061147-d645-4c86-808e-a018343e5a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:34.643474 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061147-d645-4c86-808e-a018343e5a51 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:34.643965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061147-d645-4c86-808e-a018343e5a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:34.644520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061147-d645-4c86-808e-a018343e5a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:34.747755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061147-d645-4c86-808e-a018343e5a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:34.752906 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061147-d645-4c86-808e-a018343e5a51 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:34.775048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 944/1888] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:35.289195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fffa80-0e9f-4bdc-826e-1396767864fe None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:35.290403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fffa80-0e9f-4bdc-826e-1396767864fe None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:35.290867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fffa80-0e9f-4bdc-826e-1396767864fe None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:35.295302 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 945/1889] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 19:54:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:54:35.307228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8117c-bafc-421d-ac82-51916783f30f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:35.308062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8117c-bafc-421d-ac82-51916783f30f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:35.308728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8117c-bafc-421d-ac82-51916783f30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:35.353267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-dcf8117c-bafc-421d-ac82-51916783f30f None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:35.356499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-dcf8117c-bafc-421d-ac82-51916783f30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:35.477126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 945/1890] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 19:54:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:35.501149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fffa80-0e9f-4bdc-826e-1396767864fe None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:35.504098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d9fffa80-0e9f-4bdc-826e-1396767864fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:35.556194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fffa80-0e9f-4bdc-826e-1396767864fe None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:35.563429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c8bf2-d2be-4a21-a721-a15265aa8446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:35.564470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c8bf2-d2be-4a21-a721-a15265aa8446 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:35.565109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c8bf2-d2be-4a21-a721-a15265aa8446 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:35.565522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c8bf2-d2be-4a21-a721-a15265aa8446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:35.591070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c8bf2-d2be-4a21-a721-a15265aa8446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:35.603582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c8bf2-d2be-4a21-a721-a15265aa8446 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:35.619547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 946/1891] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:35.802342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8117c-bafc-421d-ac82-51916783f30f None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:35.963122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8117c-bafc-421d-ac82-51916783f30f None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:35.980812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:35.982390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:35.982826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:35.983297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] PATH_INFO: `/v3/users/951c59176f82489d93db5b74ab67ffdd` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:35.985798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=951c59176f82489d93db5b74ab67ffdd)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:35.993122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:36.147062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951c59176f82489d93db5b74ab67ffdd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:36.147062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951c59176f82489d93db5b74ab67ffdd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:36.147062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951c59176f82489d93db5b74ab67ffdd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:36.155558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951c59176f82489d93db5b74ab67ffdd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:36.166644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951c59176f82489d93db5b74ab67ffdd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:36.200868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 946/1892] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:35 2022] DELETE /identity/v3/users/951c59176f82489d93db5b74ab67ffdd => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:36.206805 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226148ff-eaf9-497f-9551-b8691b66e96d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:36.207284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226148ff-eaf9-497f-9551-b8691b66e96d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:36.207750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226148ff-eaf9-497f-9551-b8691b66e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:36.211311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:36.215123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:36.275496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-226148ff-eaf9-497f-9551-b8691b66e96d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:36.280268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-226148ff-eaf9-497f-9551-b8691b66e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:36.393417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa34aa0-69f5-43e2-985e-0e83e40de59d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:36.396189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 947/1893] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:36.403480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:36.404066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:36.404390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:36.404671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:36.417081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:36.440403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226148ff-eaf9-497f-9551-b8691b66e96d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:36.443211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-226148ff-eaf9-497f-9551-b8691b66e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:36.517385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:36.520503 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:36.533042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226148ff-eaf9-497f-9551-b8691b66e96d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:36.534117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 947/1894] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:36.537479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12477a-0bbd-4c1c-a82f-096a16e0da60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:36.538284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12477a-0bbd-4c1c-a82f-096a16e0da60 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:36.539523 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12477a-0bbd-4c1c-a82f-096a16e0da60 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:36.540304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12477a-0bbd-4c1c-a82f-096a16e0da60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:36.552831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12477a-0bbd-4c1c-a82f-096a16e0da60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:36.555034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12477a-0bbd-4c1c-a82f-096a16e0da60 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:36.572810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 948/1895] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:37.042846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:37.045430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:37.075868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622b546-9e8e-477c-95fb-ad629873ca39 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:37.085348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:37.087592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:37.088226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:37.088811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] PATH_INFO: `/v3/projects/2e0f8774c0494e54b4b184b5c933ac07` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:37.093744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0f8774c0494e54b4b184b5c933ac07)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:37.097019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:37.209215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0f8774c0494e54b4b184b5c933ac07', 'request_id': 'req-94a2343e-b806-421c-b490-32c7ae257e26'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.227837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0f8774c0494e54b4b184b5c933ac07', 'request_id': 'req-94a2343e-b806-421c-b490-32c7ae257e26'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.246439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0f8774c0494e54b4b184b5c933ac07', 'request_id': 'req-94a2343e-b806-421c-b490-32c7ae257e26'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.279902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] The token cache is being invalidate because project 2e0f8774c0494e54b4b184b5c933ac07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:37.280265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.281102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.283240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 948/1896] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:37 2022] DELETE /identity/v3/projects/2e0f8774c0494e54b4b184b5c933ac07 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:37.288149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12477a-0bbd-4c1c-a82f-096a16e0da60 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:37.306340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12477a-0bbd-4c1c-a82f-096a16e0da60 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:37.403597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:37.404704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:37.404854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:37.407172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] PATH_INFO: `/v3/users/13a128d862a74603a82d280be58b5e20` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:37.409806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a128d862a74603a82d280be58b5e20)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:37.412629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:37.505856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a128d862a74603a82d280be58b5e20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.523395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a128d862a74603a82d280be58b5e20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.542745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a128d862a74603a82d280be58b5e20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.543910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a128d862a74603a82d280be58b5e20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.554299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d11ad99f-d2bb-4920-8186-137dccbcd399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a128d862a74603a82d280be58b5e20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:37.563651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 949/1897] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:37 2022] DELETE /identity/v3/users/13a128d862a74603a82d280be58b5e20 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:38.406214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:38.408688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:38.434591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2343e-b806-421c-b490-32c7ae257e26 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:38.534393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:38.535434 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:38.535763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:38.536166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] PATH_INFO: `/v3/projects/2c641290b9394863883eca89254b7636` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:38.537618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c641290b9394863883eca89254b7636)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:38.540723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:38.621588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c641290b9394863883eca89254b7636', 'request_id': 'req-4af80452-53f4-4ac4-9d35-9b35fda7684c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:38.631646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c641290b9394863883eca89254b7636', 'request_id': 'req-4af80452-53f4-4ac4-9d35-9b35fda7684c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:38.640230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c641290b9394863883eca89254b7636', 'request_id': 'req-4af80452-53f4-4ac4-9d35-9b35fda7684c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:38.660333 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] The token cache is being invalidate because project 2c641290b9394863883eca89254b7636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:38.660751 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:38.661512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4af80452-53f4-4ac4-9d35-9b35fda7684c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:38.663329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 949/1898] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:38 2022] DELETE /identity/v3/projects/2c641290b9394863883eca89254b7636 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:38.668881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8002-8acf-4f4a-a34d-a0faf158274a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:38.669552 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8002-8acf-4f4a-a34d-a0faf158274a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:38.669552 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8002-8acf-4f4a-a34d-a0faf158274a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:38.692721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-58ed8002-8acf-4f4a-a34d-a0faf158274a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:38.694389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-58ed8002-8acf-4f4a-a34d-a0faf158274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:38.781631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 950/1899] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:38.796444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997816a5-2c8a-405f-9085-8322a95e3e5b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:38.796942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997816a5-2c8a-405f-9085-8322a95e3e5b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:38.797670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997816a5-2c8a-405f-9085-8322a95e3e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:38.850847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-997816a5-2c8a-405f-9085-8322a95e3e5b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:38.852854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-997816a5-2c8a-405f-9085-8322a95e3e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:38.865980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 950/1900] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:38.873189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed8002-8acf-4f4a-a34d-a0faf158274a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:38.886539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed8002-8acf-4f4a-a34d-a0faf158274a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:38.894510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041c444-fe7d-4e1e-8078-2b659567b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:38.895548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041c444-fe7d-4e1e-8078-2b659567b85a admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:38.895828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041c444-fe7d-4e1e-8078-2b659567b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:38.896156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041c444-fe7d-4e1e-8078-2b659567b85a admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:38.896919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041c444-fe7d-4e1e-8078-2b659567b85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:38.897398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041c444-fe7d-4e1e-8078-2b659567b85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:38.899685 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041c444-fe7d-4e1e-8078-2b659567b85a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:38.914696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 951/1901] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:54:38.922123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997816a5-2c8a-405f-9085-8322a95e3e5b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:38.935912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997816a5-2c8a-405f-9085-8322a95e3e5b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:38.963074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be04f-4cdb-43eb-b13b-b93d3f12c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:38.964327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be04f-4cdb-43eb-b13b-b93d3f12c7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:38.966114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be04f-4cdb-43eb-b13b-b93d3f12c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:38.966625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be04f-4cdb-43eb-b13b-b93d3f12c7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:38.968145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be04f-4cdb-43eb-b13b-b93d3f12c7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:38.970639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be04f-4cdb-43eb-b13b-b93d3f12c7c8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:39.033988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 951/1902] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:38 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:39.040151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041c444-fe7d-4e1e-8078-2b659567b85a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:39.074577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041c444-fe7d-4e1e-8078-2b659567b85a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:39.212577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92168f3-d637-4761-a721-c89f71412463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:39.213231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92168f3-d637-4761-a721-c89f71412463 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:39.213509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92168f3-d637-4761-a721-c89f71412463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:39.214090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92168f3-d637-4761-a721-c89f71412463 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:39.215102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92168f3-d637-4761-a721-c89f71412463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:39.218614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92168f3-d637-4761-a721-c89f71412463 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:39.244292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 952/1903] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:39 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:39.249677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be04f-4cdb-43eb-b13b-b93d3f12c7c8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:39.271400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be04f-4cdb-43eb-b13b-b93d3f12c7c8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:39.292524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217ec1-2c09-4c13-971d-e35b407a95a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:39.293856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217ec1-2c09-4c13-971d-e35b407a95a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:39.294111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217ec1-2c09-4c13-971d-e35b407a95a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:39.294557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217ec1-2c09-4c13-971d-e35b407a95a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:39.295973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8217ec1-2c09-4c13-971d-e35b407a95a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:39.304201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8217ec1-2c09-4c13-971d-e35b407a95a4 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:39.317999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 952/1904] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:39.323272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92168f3-d637-4761-a721-c89f71412463 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:39.340478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92168f3-d637-4761-a721-c89f71412463 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:39.355834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289ec75-fa16-4946-9037-6e8bf056d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:39.356809 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ec75-fa16-4946-9037-6e8bf056d9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:39.357287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ec75-fa16-4946-9037-6e8bf056d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:39.357750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289ec75-fa16-4946-9037-6e8bf056d9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:39.359030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289ec75-fa16-4946-9037-6e8bf056d9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:39.361757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289ec75-fa16-4946-9037-6e8bf056d9c4 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:39.379286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 953/1905] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:39.386378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217ec1-2c09-4c13-971d-e35b407a95a4 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:39.402595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217ec1-2c09-4c13-971d-e35b407a95a4 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:39.408402 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f5726-4a65-4094-8386-ab7e52799cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:39.409521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5726-4a65-4094-8386-ab7e52799cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:39.409658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5726-4a65-4094-8386-ab7e52799cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:39.409901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5726-4a65-4094-8386-ab7e52799cd4 admin admin] PATH_INFO: `/v3/projects/b3fd2e4070744866814f946b5d88570e/users/f28b0d2d0a9046669b4cc517ec5406e4/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:39.433830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f5726-4a65-4094-8386-ab7e52799cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3fd2e4070744866814f946b5d88570e, user_id=f28b0d2d0a9046669b4cc517ec5406e4, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:39.436885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f5726-4a65-4094-8386-ab7e52799cd4 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:39.454778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 953/1906] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:39 2022] PUT /identity/v3/projects/b3fd2e4070744866814f946b5d88570e/users/f28b0d2d0a9046669b4cc517ec5406e4/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:39.471091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5276de-7b10-4baf-9363-cf7b1f4eef4d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:39.471597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5276de-7b10-4baf-9363-cf7b1f4eef4d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:39.472012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5276de-7b10-4baf-9363-cf7b1f4eef4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:39.507152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fd5276de-7b10-4baf-9363-cf7b1f4eef4d None None] MFA Rules not processed for user `f28b0d2d0a9046669b4cc517ec5406e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:39.508452 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fd5276de-7b10-4baf-9363-cf7b1f4eef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:39.596981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 954/1907] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:39.601063 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f5726-4a65-4094-8386-ab7e52799cd4 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:39.741724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f5726-4a65-4094-8386-ab7e52799cd4 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:39.750881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f3c5c-5383-4b5b-9588-3e5332889bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:39.752167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f3c5c-5383-4b5b-9588-3e5332889bce admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:39.753296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f3c5c-5383-4b5b-9588-3e5332889bce admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:39.754611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f3c5c-5383-4b5b-9588-3e5332889bce admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:39.755591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f3c5c-5383-4b5b-9588-3e5332889bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:39.764859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f3c5c-5383-4b5b-9588-3e5332889bce admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:39.804485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 954/1908] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:39 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:39.809838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5276de-7b10-4baf-9363-cf7b1f4eef4d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:39.827765 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5276de-7b10-4baf-9363-cf7b1f4eef4d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:39.983030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c032718-69e4-467f-8bdf-edf2a614b9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:39.984248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c032718-69e4-467f-8bdf-edf2a614b9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:39.984827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c032718-69e4-467f-8bdf-edf2a614b9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:39.985325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c032718-69e4-467f-8bdf-edf2a614b9d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:39.986938 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c032718-69e4-467f-8bdf-edf2a614b9d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:39.990675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c032718-69e4-467f-8bdf-edf2a614b9d2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:40.013369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 955/1909] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:39 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:40.018201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f3c5c-5383-4b5b-9588-3e5332889bce admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:40.036643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f3c5c-5383-4b5b-9588-3e5332889bce admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:40.043996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b65583-52cc-44af-88e8-9b9678ba3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:40.044681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b65583-52cc-44af-88e8-9b9678ba3eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:40.044960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b65583-52cc-44af-88e8-9b9678ba3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:40.045230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b65583-52cc-44af-88e8-9b9678ba3eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:40.045985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b65583-52cc-44af-88e8-9b9678ba3eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:40.047620 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b65583-52cc-44af-88e8-9b9678ba3eb8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:40.061743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 955/1910] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:40.066555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c032718-69e4-467f-8bdf-edf2a614b9d2 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:40.077836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c032718-69e4-467f-8bdf-edf2a614b9d2 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:40.083723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cc698-dc3b-40e9-bdff-4a82f0cd9960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:40.084687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cc698-dc3b-40e9-bdff-4a82f0cd9960 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:40.085084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cc698-dc3b-40e9-bdff-4a82f0cd9960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:40.085429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cc698-dc3b-40e9-bdff-4a82f0cd9960 admin admin] PATH_INFO: `/v3/projects/73f25fdd21934666b57b5f2f1647144d/users/1d7f23a2936d413383e70284a3a0df86/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:40.104522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cc698-dc3b-40e9-bdff-4a82f0cd9960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f25fdd21934666b57b5f2f1647144d, user_id=1d7f23a2936d413383e70284a3a0df86, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:40.107793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cc698-dc3b-40e9-bdff-4a82f0cd9960 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:40.123523 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 956/1911] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:40 2022] PUT /identity/v3/projects/73f25fdd21934666b57b5f2f1647144d/users/1d7f23a2936d413383e70284a3a0df86/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:40.127945 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b65583-52cc-44af-88e8-9b9678ba3eb8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:40.139101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b65583-52cc-44af-88e8-9b9678ba3eb8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:40.206877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecbbc4-13c0-4690-8bbc-71281ff83828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:40.207887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecbbc4-13c0-4690-8bbc-71281ff83828 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:40.208366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecbbc4-13c0-4690-8bbc-71281ff83828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:40.208810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecbbc4-13c0-4690-8bbc-71281ff83828 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:40.210006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecbbc4-13c0-4690-8bbc-71281ff83828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:40.212076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecbbc4-13c0-4690-8bbc-71281ff83828 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:40.225258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 956/1912] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:40.231036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cc698-dc3b-40e9-bdff-4a82f0cd9960 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:40.244760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cc698-dc3b-40e9-bdff-4a82f0cd9960 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:40.249807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e2559-0db6-422c-85ff-47f6a9096ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:40.250931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e2559-0db6-422c-85ff-47f6a9096ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:40.251209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e2559-0db6-422c-85ff-47f6a9096ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:40.251484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e2559-0db6-422c-85ff-47f6a9096ab5 admin admin] PATH_INFO: `/v3/projects/73f25fdd21934666b57b5f2f1647144d/users/1d7f23a2936d413383e70284a3a0df86/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:40.253693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e2559-0db6-422c-85ff-47f6a9096ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f25fdd21934666b57b5f2f1647144d, user_id=1d7f23a2936d413383e70284a3a0df86, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:40.256481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e2559-0db6-422c-85ff-47f6a9096ab5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:40.268922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 957/1913] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:40 2022] PUT /identity/v3/projects/73f25fdd21934666b57b5f2f1647144d/users/1d7f23a2936d413383e70284a3a0df86/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:40.280587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19153c36-e864-4cfd-88e2-5f8ba183b223 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:40.281499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19153c36-e864-4cfd-88e2-5f8ba183b223 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:40.282090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19153c36-e864-4cfd-88e2-5f8ba183b223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:40.335301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-19153c36-e864-4cfd-88e2-5f8ba183b223 None None] MFA Rules not processed for user `1d7f23a2936d413383e70284a3a0df86`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:40.337811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-19153c36-e864-4cfd-88e2-5f8ba183b223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:40.479364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 957/1914] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:40.499609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e2559-0db6-422c-85ff-47f6a9096ab5 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:40.501619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-661e2559-0db6-422c-85ff-47f6a9096ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:40.616683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e2559-0db6-422c-85ff-47f6a9096ab5 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:40.624776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf0191-d5fb-4910-86d8-b3b6c8be38cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:40.626286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf0191-d5fb-4910-86d8-b3b6c8be38cd service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:40.626832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf0191-d5fb-4910-86d8-b3b6c8be38cd service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:40.627373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf0191-d5fb-4910-86d8-b3b6c8be38cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:40.647347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf0191-d5fb-4910-86d8-b3b6c8be38cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:40.651080 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf0191-d5fb-4910-86d8-b3b6c8be38cd service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:40.673646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 958/1915] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:40.908262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19153c36-e864-4cfd-88e2-5f8ba183b223 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:41.054352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19153c36-e864-4cfd-88e2-5f8ba183b223 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:41.062556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:41.064955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:41.065500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:41.066010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] PATH_INFO: `/v3/users/f28b0d2d0a9046669b4cc517ec5406e4` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:41.067636 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28b0d2d0a9046669b4cc517ec5406e4)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:41.069720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:41.183494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28b0d2d0a9046669b4cc517ec5406e4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:41.184330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28b0d2d0a9046669b4cc517ec5406e4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:41.185751 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28b0d2d0a9046669b4cc517ec5406e4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:41.197322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28b0d2d0a9046669b4cc517ec5406e4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:41.216316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28b0d2d0a9046669b4cc517ec5406e4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:41.244053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 958/1916] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:40 2022] DELETE /identity/v3/users/f28b0d2d0a9046669b4cc517ec5406e4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:41.247986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03e8c-c1f7-4464-9e6e-b4aa8cafe850 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:41.248915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03e8c-c1f7-4464-9e6e-b4aa8cafe850 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:41.249434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03e8c-c1f7-4464-9e6e-b4aa8cafe850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:41.293160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-60c03e8c-c1f7-4464-9e6e-b4aa8cafe850 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:41.297151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-60c03e8c-c1f7-4464-9e6e-b4aa8cafe850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:41.418046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 959/1917] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:41.427090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:41.429906 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:41.541789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c43ab-143b-4803-8a52-93314745076c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:41.549760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9778df-074e-4856-b8d6-193726fe095a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:41.550482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9778df-074e-4856-b8d6-193726fe095a service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:41.550797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9778df-074e-4856-b8d6-193726fe095a service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:41.551078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9778df-074e-4856-b8d6-193726fe095a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:41.562009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9778df-074e-4856-b8d6-193726fe095a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:41.563883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9778df-074e-4856-b8d6-193726fe095a service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:41.580256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 959/1918] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:42.013834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c03e8c-c1f7-4464-9e6e-b4aa8cafe850 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:42.015926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-60c03e8c-c1f7-4464-9e6e-b4aa8cafe850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:42.046821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c03e8c-c1f7-4464-9e6e-b4aa8cafe850 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:42.082254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:42.083842 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:42.084334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:42.084828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] PATH_INFO: `/v3/projects/b3fd2e4070744866814f946b5d88570e` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:42.086975 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3fd2e4070744866814f946b5d88570e)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:42.089473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:42.166885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3fd2e4070744866814f946b5d88570e', 'request_id': 'req-fe9351fa-73b7-465a-9650-fb7fb4cded06'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.174497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3fd2e4070744866814f946b5d88570e', 'request_id': 'req-fe9351fa-73b7-465a-9650-fb7fb4cded06'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.185013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3fd2e4070744866814f946b5d88570e', 'request_id': 'req-fe9351fa-73b7-465a-9650-fb7fb4cded06'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.209849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] The token cache is being invalidate because project b3fd2e4070744866814f946b5d88570e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:42.210222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.211096 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.214440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 960/1919] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:42 2022] DELETE /identity/v3/projects/b3fd2e4070744866814f946b5d88570e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:42.219826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9778df-074e-4856-b8d6-193726fe095a service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:42.233087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9778df-074e-4856-b8d6-193726fe095a service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:42.312221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:42.313877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:42.313877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:42.314371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] PATH_INFO: `/v3/users/1d7f23a2936d413383e70284a3a0df86` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:42.316085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d7f23a2936d413383e70284a3a0df86)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:42.318095 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:42.385406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d7f23a2936d413383e70284a3a0df86'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.386241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d7f23a2936d413383e70284a3a0df86'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.387021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d7f23a2936d413383e70284a3a0df86'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.395813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d7f23a2936d413383e70284a3a0df86'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.407859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eb171042-e001-4837-9aeb-1cd76db446fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d7f23a2936d413383e70284a3a0df86'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:42.437329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 960/1920] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:42 2022] DELETE /identity/v3/users/1d7f23a2936d413383e70284a3a0df86 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:42.855257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:42.857160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:42.878927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9351fa-73b7-465a-9650-fb7fb4cded06 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:42.968484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:42.970115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:42.970624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:42.971063 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] PATH_INFO: `/v3/projects/73f25fdd21934666b57b5f2f1647144d` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:42.973234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f25fdd21934666b57b5f2f1647144d)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:42.977050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:43.049679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f25fdd21934666b57b5f2f1647144d', 'request_id': 'req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:43.066358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f25fdd21934666b57b5f2f1647144d', 'request_id': 'req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:43.075277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f25fdd21934666b57b5f2f1647144d', 'request_id': 'req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:43.097977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] The token cache is being invalidate because project 73f25fdd21934666b57b5f2f1647144d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:43.098230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:43.110524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e5c7c2b1-55e7-43ea-8d87-ce51e85b28f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:43.118339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 961/1921] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:42 2022] DELETE /identity/v3/projects/73f25fdd21934666b57b5f2f1647144d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:43.122804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c59a-605a-43e2-9b74-d2a36ef30c19 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:43.123897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c59a-605a-43e2-9b74-d2a36ef30c19 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:43.125065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c59a-605a-43e2-9b74-d2a36ef30c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:43.151353 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d579c59a-605a-43e2-9b74-d2a36ef30c19 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:43.152921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d579c59a-605a-43e2-9b74-d2a36ef30c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:43.231555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 961/1922] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:43.244967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7447d3-e118-4caf-91b6-dd54c693a7ab None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:43.245178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7447d3-e118-4caf-91b6-dd54c693a7ab None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:43.245639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7447d3-e118-4caf-91b6-dd54c693a7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:43.271496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6c7447d3-e118-4caf-91b6-dd54c693a7ab None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:43.273580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6c7447d3-e118-4caf-91b6-dd54c693a7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:43.286422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 962/1923] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:43.287692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c59a-605a-43e2-9b74-d2a36ef30c19 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:43.300916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c59a-605a-43e2-9b74-d2a36ef30c19 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:43.313893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdb2ba-f3f7-422c-b7b4-79146090cb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:43.314626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb2ba-f3f7-422c-b7b4-79146090cb95 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:43.314912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb2ba-f3f7-422c-b7b4-79146090cb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:43.315190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb2ba-f3f7-422c-b7b4-79146090cb95 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:43.316101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdb2ba-f3f7-422c-b7b4-79146090cb95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:43.316411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdb2ba-f3f7-422c-b7b4-79146090cb95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:43.319348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdb2ba-f3f7-422c-b7b4-79146090cb95 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:43.344599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7447d3-e118-4caf-91b6-dd54c693a7ab None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:43.354712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7447d3-e118-4caf-91b6-dd54c693a7ab None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:43.355700 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 962/1924] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:54:43.360625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cb4d0-f37f-41c2-a718-19e0d0d535df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:43.361229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb4d0-f37f-41c2-a718-19e0d0d535df admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:43.361512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb4d0-f37f-41c2-a718-19e0d0d535df admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:43.361789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb4d0-f37f-41c2-a718-19e0d0d535df admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:43.362523 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cb4d0-f37f-41c2-a718-19e0d0d535df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:43.364498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cb4d0-f37f-41c2-a718-19e0d0d535df admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:43.411319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 963/1925] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:43 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:43.414639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdb2ba-f3f7-422c-b7b4-79146090cb95 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:43.428981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdb2ba-f3f7-422c-b7b4-79146090cb95 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:43.510309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9a6e6-da6d-4efa-af48-60dae241dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:43.511328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a6e6-da6d-4efa-af48-60dae241dccb admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:43.511675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a6e6-da6d-4efa-af48-60dae241dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:43.511961 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9a6e6-da6d-4efa-af48-60dae241dccb admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:43.512730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9a6e6-da6d-4efa-af48-60dae241dccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:43.514790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9a6e6-da6d-4efa-af48-60dae241dccb admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:43.544004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 963/1926] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:43 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:43.548089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cb4d0-f37f-41c2-a718-19e0d0d535df admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:43.559844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cb4d0-f37f-41c2-a718-19e0d0d535df admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:43.565857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7e5e3-45a0-461b-b820-052f5b73febd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:43.566617 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7e5e3-45a0-461b-b820-052f5b73febd admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:43.566978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7e5e3-45a0-461b-b820-052f5b73febd admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:43.567432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7e5e3-45a0-461b-b820-052f5b73febd admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:43.568398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7e5e3-45a0-461b-b820-052f5b73febd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:43.570584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7e5e3-45a0-461b-b820-052f5b73febd admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:43.598283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 964/1927] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:43.601818 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9a6e6-da6d-4efa-af48-60dae241dccb admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:43.619332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9a6e6-da6d-4efa-af48-60dae241dccb admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:43.627891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5eba6a-bbbe-44fa-bdb8-0f8a6d076715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:43.629085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eba6a-bbbe-44fa-bdb8-0f8a6d076715 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:43.629763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eba6a-bbbe-44fa-bdb8-0f8a6d076715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:43.630301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eba6a-bbbe-44fa-bdb8-0f8a6d076715 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:43.632001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5eba6a-bbbe-44fa-bdb8-0f8a6d076715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:43.635310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5eba6a-bbbe-44fa-bdb8-0f8a6d076715 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:43.664465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 964/1928] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:43.669772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7e5e3-45a0-461b-b820-052f5b73febd admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:43.691445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7e5e3-45a0-461b-b820-052f5b73febd admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:43.700158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858680-990e-4987-ada5-2359c3f19376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:43.701913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858680-990e-4987-ada5-2359c3f19376 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:43.702387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858680-990e-4987-ada5-2359c3f19376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:43.702944 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858680-990e-4987-ada5-2359c3f19376 admin admin] PATH_INFO: `/v3/projects/40fcbec6818e485eb3be492d4db0a994/users/71fe62cbc9ef4b77a311ffb82cf250be/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:43.726233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3858680-990e-4987-ada5-2359c3f19376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fcbec6818e485eb3be492d4db0a994, user_id=71fe62cbc9ef4b77a311ffb82cf250be, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:43.729073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3858680-990e-4987-ada5-2359c3f19376 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:43.748201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 965/1929] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:43 2022] PUT /identity/v3/projects/40fcbec6818e485eb3be492d4db0a994/users/71fe62cbc9ef4b77a311ffb82cf250be/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:43.761136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a7c51-4e31-44ff-a6a7-048961d29c85 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:43.761591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a7c51-4e31-44ff-a6a7-048961d29c85 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:43.762203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a7c51-4e31-44ff-a6a7-048961d29c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:43.797514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0b2a7c51-4e31-44ff-a6a7-048961d29c85 None None] MFA Rules not processed for user `71fe62cbc9ef4b77a311ffb82cf250be`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:43.799249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0b2a7c51-4e31-44ff-a6a7-048961d29c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:43.892194 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 965/1930] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:43.918727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858680-990e-4987-ada5-2359c3f19376 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:43.920815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d3858680-990e-4987-ada5-2359c3f19376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:44.006700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858680-990e-4987-ada5-2359c3f19376 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:44.010898 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e62e48-3629-4678-9f6b-61dead3eeefe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:44.012577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62e48-3629-4678-9f6b-61dead3eeefe service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:44.012863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62e48-3629-4678-9f6b-61dead3eeefe service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:44.013132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62e48-3629-4678-9f6b-61dead3eeefe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:44.022865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e62e48-3629-4678-9f6b-61dead3eeefe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:44.024320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e62e48-3629-4678-9f6b-61dead3eeefe service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:44.034529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 966/1931] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:47.961372 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a7c51-4e31-44ff-a6a7-048961d29c85 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:47.965219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0b2a7c51-4e31-44ff-a6a7-048961d29c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:48.049416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a7c51-4e31-44ff-a6a7-048961d29c85 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:48.054224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:48.055123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:48.055404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:48.055681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] PATH_INFO: `/v3/users/6e8e42549ecb47aea2684767019f504b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:48.056983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8e42549ecb47aea2684767019f504b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:48.059157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:48.117850 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8e42549ecb47aea2684767019f504b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:48.118591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8e42549ecb47aea2684767019f504b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:48.119438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8e42549ecb47aea2684767019f504b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:48.130621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8e42549ecb47aea2684767019f504b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:48.140224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8e42549ecb47aea2684767019f504b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:48.161102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 966/1932] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:47 2022] DELETE /identity/v3/users/6e8e42549ecb47aea2684767019f504b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:48.166951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e244f7-8a21-47d6-9482-e8a4b3d0308a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:48.167547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e244f7-8a21-47d6-9482-e8a4b3d0308a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:48.167547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e244f7-8a21-47d6-9482-e8a4b3d0308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:48.187524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-21e244f7-8a21-47d6-9482-e8a4b3d0308a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:48.188787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-21e244f7-8a21-47d6-9482-e8a4b3d0308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:48.271284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 967/1933] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:48.281760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:48.284802 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:48.371337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901b0b6-453f-40bf-a72f-db6850219827 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:48.375459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540607ce-3e73-47f4-bb63-4adc40f64847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:48.376267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540607ce-3e73-47f4-bb63-4adc40f64847 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:48.376676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540607ce-3e73-47f4-bb63-4adc40f64847 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:48.377217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540607ce-3e73-47f4-bb63-4adc40f64847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:48.387893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540607ce-3e73-47f4-bb63-4adc40f64847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:48.389754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540607ce-3e73-47f4-bb63-4adc40f64847 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:48.401436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 967/1934] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:49.004092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e244f7-8a21-47d6-9482-e8a4b3d0308a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:49.006891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-21e244f7-8a21-47d6-9482-e8a4b3d0308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:49.022533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e244f7-8a21-47d6-9482-e8a4b3d0308a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:49.028827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:49.030093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:49.030632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:49.030955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] PATH_INFO: `/v3/projects/51123662771a4e8686781aed7551ed0b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:49.032964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=51123662771a4e8686781aed7551ed0b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:49.035469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:49.096892 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51123662771a4e8686781aed7551ed0b', 'request_id': 'req-84d5ca07-c580-444c-80d0-486929256bbe'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.104235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51123662771a4e8686781aed7551ed0b', 'request_id': 'req-84d5ca07-c580-444c-80d0-486929256bbe'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.121240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51123662771a4e8686781aed7551ed0b', 'request_id': 'req-84d5ca07-c580-444c-80d0-486929256bbe'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.151355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] The token cache is being invalidate because project 51123662771a4e8686781aed7551ed0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:49.151655 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.153119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.158199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 968/1935] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:49 2022] DELETE /identity/v3/projects/51123662771a4e8686781aed7551ed0b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:49.159678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540607ce-3e73-47f4-bb63-4adc40f64847 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:49.172125 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540607ce-3e73-47f4-bb63-4adc40f64847 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:49.251412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:49.252494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:49.252897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:49.253252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] PATH_INFO: `/v3/users/6706fbb67f08421881ac81d806d55183` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:49.254685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6706fbb67f08421881ac81d806d55183)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:49.256774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:49.294857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:49.296476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:49.310861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5ca07-c580-444c-80d0-486929256bbe admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:49.316717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:49.317690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:49.317993 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:49.318413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] PATH_INFO: `/v3/users/71b171b8909f41e4a909a93edeee136f` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:49.320625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b171b8909f41e4a909a93edeee136f)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:49.324983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:49.338547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6706fbb67f08421881ac81d806d55183'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.339960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6706fbb67f08421881ac81d806d55183'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.341672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6706fbb67f08421881ac81d806d55183'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.357314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6706fbb67f08421881ac81d806d55183'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.374582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a3146f51-4de6-4bad-b6f4-b053b6e2877c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6706fbb67f08421881ac81d806d55183'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.399139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b171b8909f41e4a909a93edeee136f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.407612 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 968/1936] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:49 2022] DELETE /identity/v3/users/6706fbb67f08421881ac81d806d55183 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:49.426397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b171b8909f41e4a909a93edeee136f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.449750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b171b8909f41e4a909a93edeee136f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.450915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b171b8909f41e4a909a93edeee136f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.472710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b171b8909f41e4a909a93edeee136f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.486023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 969/1937] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:49 2022] DELETE /identity/v3/users/71b171b8909f41e4a909a93edeee136f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:49.490847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ca035-e1a4-4fa6-b3d3-035831c631c0 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:49.491354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ca035-e1a4-4fa6-b3d3-035831c631c0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:49.491804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ca035-e1a4-4fa6-b3d3-035831c631c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:49.522671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-664ca035-e1a4-4fa6-b3d3-035831c631c0 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:49.524403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-664ca035-e1a4-4fa6-b3d3-035831c631c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:49.595496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 969/1938] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:49.619957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:49.629186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:49.718297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92580c16-bf06-4d1d-b222-5ae3e4a1e87f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:49.722568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206b202-abe2-47c2-939f-af4f3bac66fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:49.723351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b202-abe2-47c2-939f-af4f3bac66fb service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:49.723896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b202-abe2-47c2-939f-af4f3bac66fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:49.724169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206b202-abe2-47c2-939f-af4f3bac66fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:49.738225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206b202-abe2-47c2-939f-af4f3bac66fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:49.743413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206b202-abe2-47c2-939f-af4f3bac66fb service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:49.745582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ca035-e1a4-4fa6-b3d3-035831c631c0 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:49.747632 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-664ca035-e1a4-4fa6-b3d3-035831c631c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:49.761606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 970/1939] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:49.773423 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ca035-e1a4-4fa6-b3d3-035831c631c0 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:49.778800 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:49.779687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:49.779966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:49.780270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] PATH_INFO: `/v3/projects/2ce3d2e4acc54046912aff5be9a986ae` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:49.781523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce3d2e4acc54046912aff5be9a986ae)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:49.783655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:49.836280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce3d2e4acc54046912aff5be9a986ae', 'request_id': 'req-f4e9a90e-4fee-476d-835c-57adfe25378b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.845076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce3d2e4acc54046912aff5be9a986ae', 'request_id': 'req-f4e9a90e-4fee-476d-835c-57adfe25378b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.852920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce3d2e4acc54046912aff5be9a986ae', 'request_id': 'req-f4e9a90e-4fee-476d-835c-57adfe25378b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.871419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] The token cache is being invalidate because project 2ce3d2e4acc54046912aff5be9a986ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:49.871939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.873031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:49.875066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 970/1940] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:49 2022] DELETE /identity/v3/projects/2ce3d2e4acc54046912aff5be9a986ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:49.879116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206b202-abe2-47c2-939f-af4f3bac66fb service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:49.893886 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206b202-abe2-47c2-939f-af4f3bac66fb service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:49.956304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:49.957423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:49.957903 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:49.958213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] PATH_INFO: `/v3/users/8647cf1491db4506b4d61efb6e714b1c` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:49.959709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8647cf1491db4506b4d61efb6e714b1c)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:49.962853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:50.032662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8647cf1491db4506b4d61efb6e714b1c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.053046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8647cf1491db4506b4d61efb6e714b1c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.064938 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8647cf1491db4506b4d61efb6e714b1c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.066289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8647cf1491db4506b4d61efb6e714b1c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.076109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8647cf1491db4506b4d61efb6e714b1c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.083480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 971/1941] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:49 2022] DELETE /identity/v3/users/8647cf1491db4506b4d61efb6e714b1c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:50.428724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:50.430769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:50.458800 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9a90e-4fee-476d-835c-57adfe25378b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:50.571929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:50.573318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:50.573784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:50.574276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] PATH_INFO: `/v3/projects/a7bd6ee0d8964a95920b5aa19e677d7a` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:50.576159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7bd6ee0d8964a95920b5aa19e677d7a)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:50.578639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:50.589163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:50.591415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:50.606783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca5228-a2dd-40df-81ea-87b9d54c6c70 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:50.613932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:50.615529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:50.616147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:50.616635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] PATH_INFO: `/v3/projects/61d2e5590f714430aba111b15d74493a` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:50.618426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d2e5590f714430aba111b15d74493a)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:50.621131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:50.648411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7bd6ee0d8964a95920b5aa19e677d7a', 'request_id': 'req-67de2584-810a-42f8-80fa-e81d95e5f799'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.657682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7bd6ee0d8964a95920b5aa19e677d7a', 'request_id': 'req-67de2584-810a-42f8-80fa-e81d95e5f799'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.665077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7bd6ee0d8964a95920b5aa19e677d7a', 'request_id': 'req-67de2584-810a-42f8-80fa-e81d95e5f799'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.679947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d2e5590f714430aba111b15d74493a', 'request_id': 'req-91d25084-270f-4766-88b2-a578033de14f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.684245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] The token cache is being invalidate because project a7bd6ee0d8964a95920b5aa19e677d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:50.684572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.685208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.686731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d2e5590f714430aba111b15d74493a', 'request_id': 'req-91d25084-270f-4766-88b2-a578033de14f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.687141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 971/1942] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:50 2022] DELETE /identity/v3/projects/a7bd6ee0d8964a95920b5aa19e677d7a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:50.691351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:50.692820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:50.700417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d2e5590f714430aba111b15d74493a', 'request_id': 'req-91d25084-270f-4766-88b2-a578033de14f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.712963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] The token cache is being invalidate because project 61d2e5590f714430aba111b15d74493a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:50.713247 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.714267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-91d25084-270f-4766-88b2-a578033de14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.716034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 972/1943] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:50 2022] DELETE /identity/v3/projects/61d2e5590f714430aba111b15d74493a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:50.721596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b781d-2a85-45d2-99c2-9b0df4ff3847 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:50.721793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b781d-2a85-45d2-99c2-9b0df4ff3847 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:50.722112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b781d-2a85-45d2-99c2-9b0df4ff3847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:50.743201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e65b781d-2a85-45d2-99c2-9b0df4ff3847 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:50.744694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e65b781d-2a85-45d2-99c2-9b0df4ff3847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:50.792852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de2584-810a-42f8-80fa-e81d95e5f799 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:50.808345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 973/1944] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:50.816010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3aea7-f94d-44b9-bf78-a9545c5f2a0e None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:50.816306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3aea7-f94d-44b9-bf78-a9545c5f2a0e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:50.816576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3aea7-f94d-44b9-bf78-a9545c5f2a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:50.840956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e9f3aea7-f94d-44b9-bf78-a9545c5f2a0e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:50.842649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e9f3aea7-f94d-44b9-bf78-a9545c5f2a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:50.855884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 974/1945] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:50.857457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3aea7-f94d-44b9-bf78-a9545c5f2a0e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:50.867208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3aea7-f94d-44b9-bf78-a9545c5f2a0e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:50.873119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:50.874297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:50.874297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:50.874581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] PATH_INFO: `/v3/users/681c64b0fd704fe184f8fed0d8793e0e` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:50.875825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=681c64b0fd704fe184f8fed0d8793e0e)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:50.877767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:50.878091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7b3c1-6098-4647-9148-466476a40c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:50.878796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7b3c1-6098-4647-9148-466476a40c8f admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:50.879082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7b3c1-6098-4647-9148-466476a40c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:50.879360 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7b3c1-6098-4647-9148-466476a40c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:50.880108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7b3c1-6098-4647-9148-466476a40c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:50.880417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7b3c1-6098-4647-9148-466476a40c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:50.882083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7b3c1-6098-4647-9148-466476a40c8f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:50.895674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 975/1946] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:54:50.900152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7b3c1-6098-4647-9148-466476a40c8f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:50.917852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7b3c1-6098-4647-9148-466476a40c8f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:50.924257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884e18-20fc-4dbd-9c99-4363bc66990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:50.925044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884e18-20fc-4dbd-9c99-4363bc66990c admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:50.925353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884e18-20fc-4dbd-9c99-4363bc66990c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:50.926010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884e18-20fc-4dbd-9c99-4363bc66990c admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:50.926849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd884e18-20fc-4dbd-9c99-4363bc66990c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:50.929009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd884e18-20fc-4dbd-9c99-4363bc66990c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:50.954044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681c64b0fd704fe184f8fed0d8793e0e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.955152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681c64b0fd704fe184f8fed0d8793e0e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.956169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681c64b0fd704fe184f8fed0d8793e0e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.959976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 976/1947] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:50 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:50.964506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884e18-20fc-4dbd-9c99-4363bc66990c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:50.966436 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-dd884e18-20fc-4dbd-9c99-4363bc66990c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:50.969329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681c64b0fd704fe184f8fed0d8793e0e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.977454 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681c64b0fd704fe184f8fed0d8793e0e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:50.998764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 972/1948] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:50 2022] DELETE /identity/v3/users/681c64b0fd704fe184f8fed0d8793e0e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:51.042336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884e18-20fc-4dbd-9c99-4363bc66990c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:51.116699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483b61-5cdc-41f0-9853-358b4777f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:51.118435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483b61-5cdc-41f0-9853-358b4777f78a admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.119829 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483b61-5cdc-41f0-9853-358b4777f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.119829 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483b61-5cdc-41f0-9853-358b4777f78a admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.120021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05483b61-5cdc-41f0-9853-358b4777f78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:51.122388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05483b61-5cdc-41f0-9853-358b4777f78a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:51.147758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 977/1949] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:50 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:51.152969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:51.170509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8064f43-cc5b-4a10-9c7b-ad4e4d307d1f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:51.182743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d03cd-bf89-47e9-b01d-03dd2c858c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:51.183948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d03cd-bf89-47e9-b01d-03dd2c858c7d admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.184466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d03cd-bf89-47e9-b01d-03dd2c858c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.184976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d03cd-bf89-47e9-b01d-03dd2c858c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.186492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d03cd-bf89-47e9-b01d-03dd2c858c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:51.190237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d03cd-bf89-47e9-b01d-03dd2c858c7d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:51.217288 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 973/1950] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:51.218230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483b61-5cdc-41f0-9853-358b4777f78a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:51.236421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483b61-5cdc-41f0-9853-358b4777f78a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:51.242076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ffbb8-552e-44e6-8915-176435dbbcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:51.242803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ffbb8-552e-44e6-8915-176435dbbcdd admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.243670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ffbb8-552e-44e6-8915-176435dbbcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.243670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ffbb8-552e-44e6-8915-176435dbbcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.244678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ffbb8-552e-44e6-8915-176435dbbcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:51.246334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ffbb8-552e-44e6-8915-176435dbbcdd admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:51.258989 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 978/1951] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:51.263161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d03cd-bf89-47e9-b01d-03dd2c858c7d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:51.274669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d03cd-bf89-47e9-b01d-03dd2c858c7d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:51.282504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118567c-fc10-411d-82be-6a01844697ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:51.283974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118567c-fc10-411d-82be-6a01844697ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.284419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118567c-fc10-411d-82be-6a01844697ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.284856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118567c-fc10-411d-82be-6a01844697ed admin admin] PATH_INFO: `/v3/projects/288238156a5042e3a1db8693ba8df85c/users/fd00b72a6dda40f68f6c4ff53033c545/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.311127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118567c-fc10-411d-82be-6a01844697ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=288238156a5042e3a1db8693ba8df85c, user_id=fd00b72a6dda40f68f6c4ff53033c545, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:51.317694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118567c-fc10-411d-82be-6a01844697ed admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:51.332272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ffbb8-552e-44e6-8915-176435dbbcdd admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:51.335837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ee3ffbb8-552e-44e6-8915-176435dbbcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:51.360911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ffbb8-552e-44e6-8915-176435dbbcdd admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:51.380810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 974/1952] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:51 2022] PUT /identity/v3/projects/288238156a5042e3a1db8693ba8df85c/users/fd00b72a6dda40f68f6c4ff53033c545/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:51.392059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386660d-35d9-46b5-a3d9-29aac833d437 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.392240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386660d-35d9-46b5-a3d9-29aac833d437 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.392393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386660d-35d9-46b5-a3d9-29aac833d437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.430393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-2386660d-35d9-46b5-a3d9-29aac833d437 None None] MFA Rules not processed for user `fd00b72a6dda40f68f6c4ff53033c545`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:51.435090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2386660d-35d9-46b5-a3d9-29aac833d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:51.490996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:51.491943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.493014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.493014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] PATH_INFO: `/v3/projects/26bb42792f8e4d93b5f0ce8cc463b578` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.493893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26bb42792f8e4d93b5f0ce8cc463b578)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:51.495943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:51.528251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 975/1953] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:51.547329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386660d-35d9-46b5-a3d9-29aac833d437 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:51.549661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2386660d-35d9-46b5-a3d9-29aac833d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:51.579823 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26bb42792f8e4d93b5f0ce8cc463b578', 'request_id': 'req-572fe2bb-317e-4a83-afa7-fe3a41d9a679'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:51.585788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26bb42792f8e4d93b5f0ce8cc463b578', 'request_id': 'req-572fe2bb-317e-4a83-afa7-fe3a41d9a679'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:51.595882 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26bb42792f8e4d93b5f0ce8cc463b578', 'request_id': 'req-572fe2bb-317e-4a83-afa7-fe3a41d9a679'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:51.611973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] The token cache is being invalidate because project 26bb42792f8e4d93b5f0ce8cc463b578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:51.612307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:51.613040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-572fe2bb-317e-4a83-afa7-fe3a41d9a679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:51.614799 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 979/1954] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:51 2022] DELETE /identity/v3/projects/26bb42792f8e4d93b5f0ce8cc463b578 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:51.619795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21fed7-a17b-4d58-9122-6cbabd328297 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.620300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21fed7-a17b-4d58-9122-6cbabd328297 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.620747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21fed7-a17b-4d58-9122-6cbabd328297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.626774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386660d-35d9-46b5-a3d9-29aac833d437 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:51.644698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-ac21fed7-a17b-4d58-9122-6cbabd328297 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:51.646001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ac21fed7-a17b-4d58-9122-6cbabd328297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:51.690976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f5fad-d0e0-426b-8e7d-33ad44f81116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:51.691544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f5fad-d0e0-426b-8e7d-33ad44f81116 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.692408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f5fad-d0e0-426b-8e7d-33ad44f81116 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.692408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f5fad-d0e0-426b-8e7d-33ad44f81116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.696971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-939f5fad-d0e0-426b-8e7d-33ad44f81116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:51.719662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 980/1955] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:51.728351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dac2e-be35-4a0d-90bf-81ded0465266 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.728831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dac2e-be35-4a0d-90bf-81ded0465266 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.729374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dac2e-be35-4a0d-90bf-81ded0465266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.759479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-979dac2e-be35-4a0d-90bf-81ded0465266 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:51.761353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-979dac2e-be35-4a0d-90bf-81ded0465266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:51.779539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 981/1956] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:51.781363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dac2e-be35-4a0d-90bf-81ded0465266 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:51.792923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dac2e-be35-4a0d-90bf-81ded0465266 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:51.798675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1b56-be1d-47e7-8ae8-7cdfff7e2a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:51.799368 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1b56-be1d-47e7-8ae8-7cdfff7e2a32 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.799650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1b56-be1d-47e7-8ae8-7cdfff7e2a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.799942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1b56-be1d-47e7-8ae8-7cdfff7e2a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.800739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a1b56-be1d-47e7-8ae8-7cdfff7e2a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:51.801045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a1b56-be1d-47e7-8ae8-7cdfff7e2a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:51.802766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a1b56-be1d-47e7-8ae8-7cdfff7e2a32 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:51.806915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f5fad-d0e0-426b-8e7d-33ad44f81116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:51.809867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f5fad-d0e0-426b-8e7d-33ad44f81116 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:51.823687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 982/1957] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:54:51.828013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 976/1958] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:51.828885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1b56-be1d-47e7-8ae8-7cdfff7e2a32 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:51.839934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1b56-be1d-47e7-8ae8-7cdfff7e2a32 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:51.845748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43b150-bbf7-4913-abed-a8b1c77ca2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:51.846556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43b150-bbf7-4913-abed-a8b1c77ca2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.847014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43b150-bbf7-4913-abed-a8b1c77ca2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.847346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43b150-bbf7-4913-abed-a8b1c77ca2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.847824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43b150-bbf7-4913-abed-a8b1c77ca2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:51.849907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43b150-bbf7-4913-abed-a8b1c77ca2d9 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:51.885525 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 983/1959] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:51 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:51.887289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f5fad-d0e0-426b-8e7d-33ad44f81116 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:51.899759 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f5fad-d0e0-426b-8e7d-33ad44f81116 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:51.960627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f15546-e2ed-4af8-af59-068fd56b3d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:51.961509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f15546-e2ed-4af8-af59-068fd56b3d65 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:51.961776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f15546-e2ed-4af8-af59-068fd56b3d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:51.962083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f15546-e2ed-4af8-af59-068fd56b3d65 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:51.963136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f15546-e2ed-4af8-af59-068fd56b3d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:51.965243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f15546-e2ed-4af8-af59-068fd56b3d65 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:51.988676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 977/1960] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:51 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:51.993779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43b150-bbf7-4913-abed-a8b1c77ca2d9 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.005358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43b150-bbf7-4913-abed-a8b1c77ca2d9 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.010542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd46b6-d6e8-4a1d-ad5e-02575143ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.011226 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd46b6-d6e8-4a1d-ad5e-02575143ed69 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.011503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd46b6-d6e8-4a1d-ad5e-02575143ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.011796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd46b6-d6e8-4a1d-ad5e-02575143ed69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.012557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd46b6-d6e8-4a1d-ad5e-02575143ed69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:52.014182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd46b6-d6e8-4a1d-ad5e-02575143ed69 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:52.024525 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 984/1961] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:52.029160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f15546-e2ed-4af8-af59-068fd56b3d65 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.039856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f15546-e2ed-4af8-af59-068fd56b3d65 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.046232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022a13e-9459-4618-a4b8-e9b22b5b0a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.046901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a13e-9459-4618-a4b8-e9b22b5b0a98 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.047184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a13e-9459-4618-a4b8-e9b22b5b0a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.047462 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a13e-9459-4618-a4b8-e9b22b5b0a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.048162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022a13e-9459-4618-a4b8-e9b22b5b0a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:52.049799 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022a13e-9459-4618-a4b8-e9b22b5b0a98 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:52.060268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 978/1962] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:52.064995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd46b6-d6e8-4a1d-ad5e-02575143ed69 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.077246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd46b6-d6e8-4a1d-ad5e-02575143ed69 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.083684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438e4b5-d60e-4812-85fa-a1a8c6fc03fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.084920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438e4b5-d60e-4812-85fa-a1a8c6fc03fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.085209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438e4b5-d60e-4812-85fa-a1a8c6fc03fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.085490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438e4b5-d60e-4812-85fa-a1a8c6fc03fb admin admin] PATH_INFO: `/v3/projects/94d836876c9e4f7d826977f66ee49239/users/55e2d8f744414df69e90b09e3bda414e/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.103523 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438e4b5-d60e-4812-85fa-a1a8c6fc03fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d836876c9e4f7d826977f66ee49239, user_id=55e2d8f744414df69e90b09e3bda414e, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:52.107179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438e4b5-d60e-4812-85fa-a1a8c6fc03fb admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:52.131573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 985/1963] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:52 2022] PUT /identity/v3/projects/94d836876c9e4f7d826977f66ee49239/users/55e2d8f744414df69e90b09e3bda414e/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:52.144174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41999ac9-4af3-432d-8e14-0b73c361d153 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.144662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41999ac9-4af3-432d-8e14-0b73c361d153 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.144936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41999ac9-4af3-432d-8e14-0b73c361d153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.187245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-41999ac9-4af3-432d-8e14-0b73c361d153 None None] MFA Rules not processed for user `55e2d8f744414df69e90b09e3bda414e`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:52.189149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-41999ac9-4af3-432d-8e14-0b73c361d153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:52.279280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 979/1964] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:52.284549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438e4b5-d60e-4812-85fa-a1a8c6fc03fb admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.358291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438e4b5-d60e-4812-85fa-a1a8c6fc03fb admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.376792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8212ec-8934-41e1-a68f-e0b6fce8d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.377532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8212ec-8934-41e1-a68f-e0b6fce8d3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.377812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8212ec-8934-41e1-a68f-e0b6fce8d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.378120 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8212ec-8934-41e1-a68f-e0b6fce8d3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.378827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8212ec-8934-41e1-a68f-e0b6fce8d3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:52.380790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8212ec-8934-41e1-a68f-e0b6fce8d3b6 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:52.410430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 986/1965] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:52 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:52.416977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41999ac9-4af3-432d-8e14-0b73c361d153 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.430541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41999ac9-4af3-432d-8e14-0b73c361d153 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.507714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b9fa5-8adb-4fc1-9d51-27aeeabd3349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.508459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b9fa5-8adb-4fc1-9d51-27aeeabd3349 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.508727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b9fa5-8adb-4fc1-9d51-27aeeabd3349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.509014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b9fa5-8adb-4fc1-9d51-27aeeabd3349 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.510583 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b9fa5-8adb-4fc1-9d51-27aeeabd3349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:52.512622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b9fa5-8adb-4fc1-9d51-27aeeabd3349 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:52.535437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 980/1966] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:52 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:52.539763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8212ec-8934-41e1-a68f-e0b6fce8d3b6 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.551493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8212ec-8934-41e1-a68f-e0b6fce8d3b6 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.556827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebadc7-b78a-4376-9847-dc6866616f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.557814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebadc7-b78a-4376-9847-dc6866616f76 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.558146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebadc7-b78a-4376-9847-dc6866616f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.558449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebadc7-b78a-4376-9847-dc6866616f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.559161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebadc7-b78a-4376-9847-dc6866616f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:52.560850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebadc7-b78a-4376-9847-dc6866616f76 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:52.574579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 987/1967] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:52.579747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b9fa5-8adb-4fc1-9d51-27aeeabd3349 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.595971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b9fa5-8adb-4fc1-9d51-27aeeabd3349 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.609113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fd85c-bc79-4099-b24b-cd591f6c5129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.610074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fd85c-bc79-4099-b24b-cd591f6c5129 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.610361 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fd85c-bc79-4099-b24b-cd591f6c5129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.610640 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fd85c-bc79-4099-b24b-cd591f6c5129 admin admin] PATH_INFO: `/v3/projects/1b758948ee0d42d28a99eefbe72308ba/users/a0f276b83bae4d7ab87450b9c31a7547/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.627263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fd85c-bc79-4099-b24b-cd591f6c5129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b758948ee0d42d28a99eefbe72308ba, user_id=a0f276b83bae4d7ab87450b9c31a7547, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:52.630272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fd85c-bc79-4099-b24b-cd591f6c5129 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:52.647195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 981/1968] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:52 2022] PUT /identity/v3/projects/1b758948ee0d42d28a99eefbe72308ba/users/a0f276b83bae4d7ab87450b9c31a7547/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:52.651696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebadc7-b78a-4376-9847-dc6866616f76 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.661787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebadc7-b78a-4376-9847-dc6866616f76 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.723470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8be9f-0cb8-47a4-a998-6ef944b30638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.724145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8be9f-0cb8-47a4-a998-6ef944b30638 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.724430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8be9f-0cb8-47a4-a998-6ef944b30638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.724705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8be9f-0cb8-47a4-a998-6ef944b30638 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.725429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8be9f-0cb8-47a4-a998-6ef944b30638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:52.727102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8be9f-0cb8-47a4-a998-6ef944b30638 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:52.740067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 988/1969] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:54:52.744461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fd85c-bc79-4099-b24b-cd591f6c5129 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.763271 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fd85c-bc79-4099-b24b-cd591f6c5129 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.768377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e680e-f380-4be9-a5c7-fc497c57bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.769368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e680e-f380-4be9-a5c7-fc497c57bc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.769650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e680e-f380-4be9-a5c7-fc497c57bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.769926 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e680e-f380-4be9-a5c7-fc497c57bc51 admin admin] PATH_INFO: `/v3/projects/1b758948ee0d42d28a99eefbe72308ba/users/a0f276b83bae4d7ab87450b9c31a7547/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.772013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e680e-f380-4be9-a5c7-fc497c57bc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b758948ee0d42d28a99eefbe72308ba, user_id=a0f276b83bae4d7ab87450b9c31a7547, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:52.774847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e680e-f380-4be9-a5c7-fc497c57bc51 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:52.786987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 982/1970] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:52 2022] PUT /identity/v3/projects/1b758948ee0d42d28a99eefbe72308ba/users/a0f276b83bae4d7ab87450b9c31a7547/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:52.798509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fad5-5db6-47f9-8f45-d3efdef0ca39 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.798863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fad5-5db6-47f9-8f45-d3efdef0ca39 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.799183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fad5-5db6-47f9-8f45-d3efdef0ca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:52.830429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-8496fad5-5db6-47f9-8f45-d3efdef0ca39 None None] MFA Rules not processed for user `a0f276b83bae4d7ab87450b9c31a7547`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:52.831642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-8496fad5-5db6-47f9-8f45-d3efdef0ca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:52.908932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 989/1971] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:52.922998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e680e-f380-4be9-a5c7-fc497c57bc51 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:52.924406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6b2e680e-f380-4be9-a5c7-fc497c57bc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:52.986769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e680e-f380-4be9-a5c7-fc497c57bc51 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:52.990572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2277cb3-16c7-4076-9150-af2a6aa17805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:52.991229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2277cb3-16c7-4076-9150-af2a6aa17805 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:52.991511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2277cb3-16c7-4076-9150-af2a6aa17805 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:52.991774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2277cb3-16c7-4076-9150-af2a6aa17805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:53.003009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2277cb3-16c7-4076-9150-af2a6aa17805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:53.004643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2277cb3-16c7-4076-9150-af2a6aa17805 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:53.020386 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 983/1972] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:53.106632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fad5-5db6-47f9-8f45-d3efdef0ca39 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:53.118888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fad5-5db6-47f9-8f45-d3efdef0ca39 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:53.122970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba3a74-0572-4bd0-87cb-499d426fdd41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:53.123770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba3a74-0572-4bd0-87cb-499d426fdd41 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:53.124287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba3a74-0572-4bd0-87cb-499d426fdd41 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:53.124647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba3a74-0572-4bd0-87cb-499d426fdd41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:53.209419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba3a74-0572-4bd0-87cb-499d426fdd41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:53.210971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba3a74-0572-4bd0-87cb-499d426fdd41 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:53.222519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 990/1973] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:54:55.343760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2277cb3-16c7-4076-9150-af2a6aa17805 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:55.345375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d2277cb3-16c7-4076-9150-af2a6aa17805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:55.448908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2277cb3-16c7-4076-9150-af2a6aa17805 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:55.453901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:55.454900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:55.455157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:55.455599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] PATH_INFO: `/v3/users/918310d4fbc047d493f7c9a1157c2f66` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:55.456979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] RBAC: Authorizing `identity:delete_user(user_id=918310d4fbc047d493f7c9a1157c2f66)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:55.459008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:55.519606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918310d4fbc047d493f7c9a1157c2f66'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:55.520248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918310d4fbc047d493f7c9a1157c2f66'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:55.520837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918310d4fbc047d493f7c9a1157c2f66'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:55.529383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918310d4fbc047d493f7c9a1157c2f66'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:55.537655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918310d4fbc047d493f7c9a1157c2f66'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:55.557828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 984/1974] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:55 2022] DELETE /identity/v3/users/918310d4fbc047d493f7c9a1157c2f66 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:55.562580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04af1b6-5b0e-4420-a0ec-c17a93907711 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:55.563065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04af1b6-5b0e-4420-a0ec-c17a93907711 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:55.563182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04af1b6-5b0e-4420-a0ec-c17a93907711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:55.582137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a04af1b6-5b0e-4420-a0ec-c17a93907711 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:55.583352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a04af1b6-5b0e-4420-a0ec-c17a93907711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:55.656721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 991/1975] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:55.667898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:55.669805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:55.735337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47b0f-d3b4-41bb-8b4f-f135920caded admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:55.739331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67d51a-7e9d-4223-a784-0771cc69d9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:55.740004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67d51a-7e9d-4223-a784-0771cc69d9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:55.740278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67d51a-7e9d-4223-a784-0771cc69d9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:55.740557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67d51a-7e9d-4223-a784-0771cc69d9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:55.750998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67d51a-7e9d-4223-a784-0771cc69d9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:55.752460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67d51a-7e9d-4223-a784-0771cc69d9e6 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:55.762817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 985/1976] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:56.067655 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04af1b6-5b0e-4420-a0ec-c17a93907711 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:56.070350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a04af1b6-5b0e-4420-a0ec-c17a93907711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:56.086924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04af1b6-5b0e-4420-a0ec-c17a93907711 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:56.094411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:56.095265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:56.095539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:56.095987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] PATH_INFO: `/v3/projects/95235f7bc3c14d0ab8101f7e805e9921` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:56.097484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=95235f7bc3c14d0ab8101f7e805e9921)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:56.099456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:56.154548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95235f7bc3c14d0ab8101f7e805e9921', 'request_id': 'req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.160212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95235f7bc3c14d0ab8101f7e805e9921', 'request_id': 'req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.170999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95235f7bc3c14d0ab8101f7e805e9921', 'request_id': 'req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.184494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] The token cache is being invalidate because project 95235f7bc3c14d0ab8101f7e805e9921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:56.184785 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.185490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.187164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 992/1977] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:56 2022] DELETE /identity/v3/projects/95235f7bc3c14d0ab8101f7e805e9921 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:54:56.191287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67d51a-7e9d-4223-a784-0771cc69d9e6 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:56.202424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67d51a-7e9d-4223-a784-0771cc69d9e6 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:56.271477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:56.272553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:56.272929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:56.273330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] PATH_INFO: `/v3/users/fdc7b2e1e26046f18618b1dc116ac3d2` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:56.274785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc7b2e1e26046f18618b1dc116ac3d2)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:56.276867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:56.326245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc7b2e1e26046f18618b1dc116ac3d2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.326884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc7b2e1e26046f18618b1dc116ac3d2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.327482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc7b2e1e26046f18618b1dc116ac3d2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.336230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc7b2e1e26046f18618b1dc116ac3d2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.344055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-26605731-989b-4424-a428-d58cb5ecff63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc7b2e1e26046f18618b1dc116ac3d2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.362866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 986/1978] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:56 2022] DELETE /identity/v3/users/fdc7b2e1e26046f18618b1dc116ac3d2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:56.763464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:56.765358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:56.782928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61595b5b-1ca3-4a7f-b4cf-b31e2759e1ff admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:56.855692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:56.857134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:56.857493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:56.857831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] PATH_INFO: `/v3/projects/4279de053f9341e0b6a913f47dc7d984` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:56.859263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4279de053f9341e0b6a913f47dc7d984)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:56.862510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:56.925275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4279de053f9341e0b6a913f47dc7d984', 'request_id': 'req-965ba392-47a0-4d0d-866d-d3fd89ccce51'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.930703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4279de053f9341e0b6a913f47dc7d984', 'request_id': 'req-965ba392-47a0-4d0d-866d-d3fd89ccce51'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.939414 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4279de053f9341e0b6a913f47dc7d984', 'request_id': 'req-965ba392-47a0-4d0d-866d-d3fd89ccce51'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.951694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] The token cache is being invalidate because project 4279de053f9341e0b6a913f47dc7d984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:54:56.951960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.952673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-965ba392-47a0-4d0d-866d-d3fd89ccce51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:54:56.954337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 993/1979] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:54:56 2022] DELETE /identity/v3/projects/4279de053f9341e0b6a913f47dc7d984 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:56.959419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2243f8a-01db-4b37-ae90-ec66a767d3d6 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:56.959741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2243f8a-01db-4b37-ae90-ec66a767d3d6 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:56.960018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2243f8a-01db-4b37-ae90-ec66a767d3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:56.979914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c2243f8a-01db-4b37-ae90-ec66a767d3d6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:56.981377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c2243f8a-01db-4b37-ae90-ec66a767d3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:57.056373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 987/1980] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:54:57.064851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b37ee2-6a99-42db-a5af-cd7faac662bb None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.065141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b37ee2-6a99-42db-a5af-cd7faac662bb None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.065416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b37ee2-6a99-42db-a5af-cd7faac662bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.095079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c4b37ee2-6a99-42db-a5af-cd7faac662bb None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:57.096275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c4b37ee2-6a99-42db-a5af-cd7faac662bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:57.105923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 994/1981] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:57.110470 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2243f8a-01db-4b37-ae90-ec66a767d3d6 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.121868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2243f8a-01db-4b37-ae90-ec66a767d3d6 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.128455 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70d0e5-130c-4b88-83d2-24e857e15a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.129280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70d0e5-130c-4b88-83d2-24e857e15a09 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.129612 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70d0e5-130c-4b88-83d2-24e857e15a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.129872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70d0e5-130c-4b88-83d2-24e857e15a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.130680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70d0e5-130c-4b88-83d2-24e857e15a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:54:57.131009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70d0e5-130c-4b88-83d2-24e857e15a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.132655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70d0e5-130c-4b88-83d2-24e857e15a09 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.146379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 988/1982] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:54:57.152589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b37ee2-6a99-42db-a5af-cd7faac662bb None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.162508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b37ee2-6a99-42db-a5af-cd7faac662bb None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.168686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe4af1-ada3-4b2e-95be-6d5d1fb177b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.169389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe4af1-ada3-4b2e-95be-6d5d1fb177b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.169665 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe4af1-ada3-4b2e-95be-6d5d1fb177b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.169930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe4af1-ada3-4b2e-95be-6d5d1fb177b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.170671 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe4af1-ada3-4b2e-95be-6d5d1fb177b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.172673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe4af1-ada3-4b2e-95be-6d5d1fb177b8 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.200997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 995/1983] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:57 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:57.205183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70d0e5-130c-4b88-83d2-24e857e15a09 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.215293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70d0e5-130c-4b88-83d2-24e857e15a09 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.282515 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7a36-8a94-4b18-b2c8-154f8e23bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.283185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7a36-8a94-4b18-b2c8-154f8e23bde2 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.283466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7a36-8a94-4b18-b2c8-154f8e23bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.283741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a7a36-8a94-4b18-b2c8-154f8e23bde2 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.284436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a7a36-8a94-4b18-b2c8-154f8e23bde2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.286462 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a7a36-8a94-4b18-b2c8-154f8e23bde2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.309355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 989/1984] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:57 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:57.313624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe4af1-ada3-4b2e-95be-6d5d1fb177b8 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.330737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe4af1-ada3-4b2e-95be-6d5d1fb177b8 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.336157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b8dbc-0195-4027-8d25-221807698d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.336849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b8dbc-0195-4027-8d25-221807698d8e admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.337129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b8dbc-0195-4027-8d25-221807698d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.337471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b8dbc-0195-4027-8d25-221807698d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.338246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b8dbc-0195-4027-8d25-221807698d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.339914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b8dbc-0195-4027-8d25-221807698d8e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.356384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 996/1985] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:57.360977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7a36-8a94-4b18-b2c8-154f8e23bde2 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.371869 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a7a36-8a94-4b18-b2c8-154f8e23bde2 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.376936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60f827-5068-4709-a0e8-2b35aef98672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.377638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60f827-5068-4709-a0e8-2b35aef98672 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.377918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60f827-5068-4709-a0e8-2b35aef98672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.378229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60f827-5068-4709-a0e8-2b35aef98672 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.378960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60f827-5068-4709-a0e8-2b35aef98672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.380684 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60f827-5068-4709-a0e8-2b35aef98672 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.393223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 990/1986] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:54:57.397924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b8dbc-0195-4027-8d25-221807698d8e admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.408578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b8dbc-0195-4027-8d25-221807698d8e admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.413499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a783fb-9948-4def-b5d7-c572176d3862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.414455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a783fb-9948-4def-b5d7-c572176d3862 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.414731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a783fb-9948-4def-b5d7-c572176d3862 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.415029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a783fb-9948-4def-b5d7-c572176d3862 admin admin] PATH_INFO: `/v3/projects/85dad53eb44948b1be7b7a99fb6c68f5/users/4b3279321b944d06903253bf192ba7d5/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.434833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a783fb-9948-4def-b5d7-c572176d3862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85dad53eb44948b1be7b7a99fb6c68f5, user_id=4b3279321b944d06903253bf192ba7d5, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.437550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a783fb-9948-4def-b5d7-c572176d3862 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.452786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 997/1987] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:57 2022] PUT /identity/v3/projects/85dad53eb44948b1be7b7a99fb6c68f5/users/4b3279321b944d06903253bf192ba7d5/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:57.466645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d1173-8567-45ae-95fc-947f432e30a9 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.466855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d1173-8567-45ae-95fc-947f432e30a9 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.467137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d1173-8567-45ae-95fc-947f432e30a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.497919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-459d1173-8567-45ae-95fc-947f432e30a9 None None] MFA Rules not processed for user `4b3279321b944d06903253bf192ba7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:57.499190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-459d1173-8567-45ae-95fc-947f432e30a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:57.570293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 991/1988] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:57.575200 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a783fb-9948-4def-b5d7-c572176d3862 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.644307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a783fb-9948-4def-b5d7-c572176d3862 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.649786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9163-d8f3-4868-90ce-97c53effd5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.650516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9163-d8f3-4868-90ce-97c53effd5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.650862 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9163-d8f3-4868-90ce-97c53effd5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.651141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9163-d8f3-4868-90ce-97c53effd5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.652096 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef9163-d8f3-4868-90ce-97c53effd5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.655733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef9163-d8f3-4868-90ce-97c53effd5e5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.689041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 998/1989] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:54:57 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:54:57.693211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d1173-8567-45ae-95fc-947f432e30a9 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.705600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d1173-8567-45ae-95fc-947f432e30a9 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.775071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ba2f6-c0f7-426a-930f-d14f50b6acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.776517 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ba2f6-c0f7-426a-930f-d14f50b6acb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.777286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ba2f6-c0f7-426a-930f-d14f50b6acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.777967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ba2f6-c0f7-426a-930f-d14f50b6acb6 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.778923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ba2f6-c0f7-426a-930f-d14f50b6acb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.782308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ba2f6-c0f7-426a-930f-d14f50b6acb6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.806770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 992/1990] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:54:57 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:54:57.811078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9163-d8f3-4868-90ce-97c53effd5e5 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.822330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9163-d8f3-4868-90ce-97c53effd5e5 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.829764 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1187e-7a9f-4657-a0c3-b9b9c50d65ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.831178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1187e-7a9f-4657-a0c3-b9b9c50d65ec admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.831739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1187e-7a9f-4657-a0c3-b9b9c50d65ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.834664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1187e-7a9f-4657-a0c3-b9b9c50d65ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.834664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1187e-7a9f-4657-a0c3-b9b9c50d65ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.835514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1187e-7a9f-4657-a0c3-b9b9c50d65ec admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.851216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 999/1991] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:54:57.856385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ba2f6-c0f7-426a-930f-d14f50b6acb6 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.867477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ba2f6-c0f7-426a-930f-d14f50b6acb6 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:57.877308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abb2f2-868f-48c2-b376-c493afe2089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:57.878391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb2f2-868f-48c2-b376-c493afe2089d admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:57.878592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb2f2-868f-48c2-b376-c493afe2089d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:57.878897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb2f2-868f-48c2-b376-c493afe2089d admin admin] PATH_INFO: `/v3/projects/3e0f16f85d5c451cb1f7c2726647f345/users/4a2865aa4b734de0a2020b2c160b43c7/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:57.902254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb2f2-868f-48c2-b376-c493afe2089d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0f16f85d5c451cb1f7c2726647f345, user_id=4a2865aa4b734de0a2020b2c160b43c7, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:57.905142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb2f2-868f-48c2-b376-c493afe2089d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:57.920268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 993/1992] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:57 2022] PUT /identity/v3/projects/3e0f16f85d5c451cb1f7c2726647f345/users/4a2865aa4b734de0a2020b2c160b43c7/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:57.925248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1187e-7a9f-4657-a0c3-b9b9c50d65ec admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:57.937949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1187e-7a9f-4657-a0c3-b9b9c50d65ec admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:58.005866 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eb586-4f91-49ea-bf04-6fedb921c858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:58.006486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eb586-4f91-49ea-bf04-6fedb921c858 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:58.006793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eb586-4f91-49ea-bf04-6fedb921c858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:58.007059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eb586-4f91-49ea-bf04-6fedb921c858 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:58.007784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eb586-4f91-49ea-bf04-6fedb921c858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:58.009580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eb586-4f91-49ea-bf04-6fedb921c858 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:58.026257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1000/1993] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:54:58.031514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abb2f2-868f-48c2-b376-c493afe2089d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:58.047081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abb2f2-868f-48c2-b376-c493afe2089d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:58.052790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f28649-984f-4298-8fcf-c8f3de939fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:58.053714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f28649-984f-4298-8fcf-c8f3de939fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:58.054049 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f28649-984f-4298-8fcf-c8f3de939fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:58.054326 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f28649-984f-4298-8fcf-c8f3de939fb9 admin admin] PATH_INFO: `/v3/projects/3e0f16f85d5c451cb1f7c2726647f345/users/4a2865aa4b734de0a2020b2c160b43c7/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:58.056663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f28649-984f-4298-8fcf-c8f3de939fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0f16f85d5c451cb1f7c2726647f345, user_id=4a2865aa4b734de0a2020b2c160b43c7, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:58.059379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f28649-984f-4298-8fcf-c8f3de939fb9 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:58.070380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 994/1994] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:54:58 2022] PUT /identity/v3/projects/3e0f16f85d5c451cb1f7c2726647f345/users/4a2865aa4b734de0a2020b2c160b43c7/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:54:58.081368 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b023446-da17-433c-8d4e-3725119f6b2b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:58.081659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b023446-da17-433c-8d4e-3725119f6b2b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:58.082039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b023446-da17-433c-8d4e-3725119f6b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:58.112119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-1b023446-da17-433c-8d4e-3725119f6b2b None None] MFA Rules not processed for user `4a2865aa4b734de0a2020b2c160b43c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:54:58.113342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1b023446-da17-433c-8d4e-3725119f6b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:58.192753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1001/1995] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:54:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:54:58.203940 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f28649-984f-4298-8fcf-c8f3de939fb9 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:58.206091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b8f28649-984f-4298-8fcf-c8f3de939fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:54:58.269283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f28649-984f-4298-8fcf-c8f3de939fb9 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:58.273234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cd968-a299-46b0-a5a5-4c895382298b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:58.273918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cd968-a299-46b0-a5a5-4c895382298b service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:58.274325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cd968-a299-46b0-a5a5-4c895382298b service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:58.274533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cd968-a299-46b0-a5a5-4c895382298b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:58.284682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cd968-a299-46b0-a5a5-4c895382298b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:58.286252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cd968-a299-46b0-a5a5-4c895382298b service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:58.297063 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 995/1996] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:54:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:54:59.841645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b023446-da17-433c-8d4e-3725119f6b2b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:54:59.919240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b023446-da17-433c-8d4e-3725119f6b2b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:54:59.925514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:54:59.926514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:54:59.926797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:54:59.927108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] PATH_INFO: `/v3/users/4b3279321b944d06903253bf192ba7d5` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:54:59.928485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3279321b944d06903253bf192ba7d5)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:54:59.930649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:54:59.995635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3279321b944d06903253bf192ba7d5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.014916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3279321b944d06903253bf192ba7d5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.026471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3279321b944d06903253bf192ba7d5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.027162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3279321b944d06903253bf192ba7d5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.034815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3279321b944d06903253bf192ba7d5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.042429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1002/1997] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:54:59 2022] DELETE /identity/v3/users/4b3279321b944d06903253bf192ba7d5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:00.047352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea1ac2-7450-47a8-a7c9-32fa9498848c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:00.047916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea1ac2-7450-47a8-a7c9-32fa9498848c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:00.047916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea1ac2-7450-47a8-a7c9-32fa9498848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:00.071466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-72ea1ac2-7450-47a8-a7c9-32fa9498848c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:00.072992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-72ea1ac2-7450-47a8-a7c9-32fa9498848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:00.143627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 996/1998] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:00.154940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:00.156434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:00.225450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4995433-c037-4ead-bab5-855a166262f1 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:00.231377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe3b6a-d720-4dd4-9414-72e77932579a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:00.232044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe3b6a-d720-4dd4-9414-72e77932579a service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:00.232321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe3b6a-d720-4dd4-9414-72e77932579a service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:00.232592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe3b6a-d720-4dd4-9414-72e77932579a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:00.252494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe3b6a-d720-4dd4-9414-72e77932579a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:00.254198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe3b6a-d720-4dd4-9414-72e77932579a service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:00.268378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1003/1999] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:00.647554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea1ac2-7450-47a8-a7c9-32fa9498848c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:00.649488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-72ea1ac2-7450-47a8-a7c9-32fa9498848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:00.661695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea1ac2-7450-47a8-a7c9-32fa9498848c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:00.667499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:00.668648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:00.668924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:00.669181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] PATH_INFO: `/v3/projects/85dad53eb44948b1be7b7a99fb6c68f5` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:00.670592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85dad53eb44948b1be7b7a99fb6c68f5)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:00.672506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:00.722848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85dad53eb44948b1be7b7a99fb6c68f5', 'request_id': 'req-fbb89d4b-002e-47cf-b72f-74935414fa73'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.729212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85dad53eb44948b1be7b7a99fb6c68f5', 'request_id': 'req-fbb89d4b-002e-47cf-b72f-74935414fa73'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.735550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85dad53eb44948b1be7b7a99fb6c68f5', 'request_id': 'req-fbb89d4b-002e-47cf-b72f-74935414fa73'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.754933 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] The token cache is being invalidate because project 85dad53eb44948b1be7b7a99fb6c68f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:00.755256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.755959 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.757676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 997/2000] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:00 2022] DELETE /identity/v3/projects/85dad53eb44948b1be7b7a99fb6c68f5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:00.762450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe3b6a-d720-4dd4-9414-72e77932579a service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:00.772595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe3b6a-d720-4dd4-9414-72e77932579a service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:00.829126 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:00.830051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:00.830338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:00.830590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] PATH_INFO: `/v3/users/4a2865aa4b734de0a2020b2c160b43c7` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:00.831848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2865aa4b734de0a2020b2c160b43c7)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:00.833878 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:00.886311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2865aa4b734de0a2020b2c160b43c7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.898197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2865aa4b734de0a2020b2c160b43c7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.907323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2865aa4b734de0a2020b2c160b43c7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.908022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2865aa4b734de0a2020b2c160b43c7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.915962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d1dfdbad-4167-41bf-a062-90431167c5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2865aa4b734de0a2020b2c160b43c7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:00.921929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1004/2001] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:00 2022] DELETE /identity/v3/users/4a2865aa4b734de0a2020b2c160b43c7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:01.232279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:01.234184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:01.247672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb89d4b-002e-47cf-b72f-74935414fa73 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:01.310580 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:01.311459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.311736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.312013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] PATH_INFO: `/v3/projects/3e0f16f85d5c451cb1f7c2726647f345` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:01.313221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0f16f85d5c451cb1f7c2726647f345)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:01.315168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:01.372211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0f16f85d5c451cb1f7c2726647f345', 'request_id': 'req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:01.378862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0f16f85d5c451cb1f7c2726647f345', 'request_id': 'req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:01.385885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0f16f85d5c451cb1f7c2726647f345', 'request_id': 'req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:01.405309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] The token cache is being invalidate because project 3e0f16f85d5c451cb1f7c2726647f345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:01.406078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:01.407102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7fa1fcf3-0c06-4f6d-a016-4d220bd1299a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:01.410173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 998/2002] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:01 2022] DELETE /identity/v3/projects/3e0f16f85d5c451cb1f7c2726647f345 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:01.417805 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b76804-6f24-4c74-8196-29439359abd2 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.418222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b76804-6f24-4c74-8196-29439359abd2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.418854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b76804-6f24-4c74-8196-29439359abd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:01.439723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-04b76804-6f24-4c74-8196-29439359abd2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:01.440993 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-04b76804-6f24-4c74-8196-29439359abd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:01.509802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1005/2003] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:01.517657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779071a0-db34-41b6-8175-6bba39102416 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.517968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779071a0-db34-41b6-8175-6bba39102416 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.518307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779071a0-db34-41b6-8175-6bba39102416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:01.538827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-779071a0-db34-41b6-8175-6bba39102416 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:01.540058 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-779071a0-db34-41b6-8175-6bba39102416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:01.550312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 999/2004] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:01.554967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b76804-6f24-4c74-8196-29439359abd2 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:01.567234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b76804-6f24-4c74-8196-29439359abd2 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:01.573141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628587a-4db7-4df3-8c8a-d33ff56dc489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:01.574120 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628587a-4db7-4df3-8c8a-d33ff56dc489 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.574431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628587a-4db7-4df3-8c8a-d33ff56dc489 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.574708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628587a-4db7-4df3-8c8a-d33ff56dc489 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:01.575722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628587a-4db7-4df3-8c8a-d33ff56dc489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:55:01.576937 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628587a-4db7-4df3-8c8a-d33ff56dc489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:01.579627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628587a-4db7-4df3-8c8a-d33ff56dc489 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:01.597423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1006/2005] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:55:01.598699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779071a0-db34-41b6-8175-6bba39102416 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:01.609055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779071a0-db34-41b6-8175-6bba39102416 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:01.614494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163e57b-f57c-454f-b20e-469d4dbcfdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:01.615204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163e57b-f57c-454f-b20e-469d4dbcfdea admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.615485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163e57b-f57c-454f-b20e-469d4dbcfdea admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.615762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163e57b-f57c-454f-b20e-469d4dbcfdea admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:01.616501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163e57b-f57c-454f-b20e-469d4dbcfdea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:01.618704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163e57b-f57c-454f-b20e-469d4dbcfdea admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:01.648835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1000/2006] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:01 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:01.656478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628587a-4db7-4df3-8c8a-d33ff56dc489 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:01.666007 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628587a-4db7-4df3-8c8a-d33ff56dc489 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:01.741301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffcaee-d554-4b6d-93da-69cb24cdc65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:01.742392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffcaee-d554-4b6d-93da-69cb24cdc65e admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.742699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffcaee-d554-4b6d-93da-69cb24cdc65e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.742973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffcaee-d554-4b6d-93da-69cb24cdc65e admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:01.743875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffcaee-d554-4b6d-93da-69cb24cdc65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:01.746089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffcaee-d554-4b6d-93da-69cb24cdc65e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:01.767805 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1007/2007] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:01 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:01.772371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163e57b-f57c-454f-b20e-469d4dbcfdea admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:01.784420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163e57b-f57c-454f-b20e-469d4dbcfdea admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:01.791365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e230f-75af-4909-9c06-a22fea4d08a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:01.792109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e230f-75af-4909-9c06-a22fea4d08a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.792567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e230f-75af-4909-9c06-a22fea4d08a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.792855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e230f-75af-4909-9c06-a22fea4d08a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:01.794389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e230f-75af-4909-9c06-a22fea4d08a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:01.796121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e230f-75af-4909-9c06-a22fea4d08a1 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:01.812412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1001/2008] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:01.813680 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffcaee-d554-4b6d-93da-69cb24cdc65e admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:01.826140 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffcaee-d554-4b6d-93da-69cb24cdc65e admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:01.839989 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448bf62-73d8-4c66-81ef-c8ca611e56fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:01.841117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448bf62-73d8-4c66-81ef-c8ca611e56fc admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.841117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448bf62-73d8-4c66-81ef-c8ca611e56fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.841347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448bf62-73d8-4c66-81ef-c8ca611e56fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:01.842100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448bf62-73d8-4c66-81ef-c8ca611e56fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:01.844518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448bf62-73d8-4c66-81ef-c8ca611e56fc admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:01.858467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1008/2009] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:01.862766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e230f-75af-4909-9c06-a22fea4d08a1 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:01.878232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e230f-75af-4909-9c06-a22fea4d08a1 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:01.886461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f304430-e442-4546-aba4-3cf467055f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:01.887989 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f304430-e442-4546-aba4-3cf467055f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.888487 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f304430-e442-4546-aba4-3cf467055f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.888981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f304430-e442-4546-aba4-3cf467055f1e admin admin] PATH_INFO: `/v3/projects/c27a6342150a4a3ea74a2d30923c9c56/users/56017826d84f45e5b966db806fd7d3e3/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:01.915168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f304430-e442-4546-aba4-3cf467055f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27a6342150a4a3ea74a2d30923c9c56, user_id=56017826d84f45e5b966db806fd7d3e3, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:01.920549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f304430-e442-4546-aba4-3cf467055f1e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:01.942277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1002/2010] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:01 2022] PUT /identity/v3/projects/c27a6342150a4a3ea74a2d30923c9c56/users/56017826d84f45e5b966db806fd7d3e3/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:55:01.963826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d35058-13a8-4ab1-846c-7220239273e2 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:01.964411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d35058-13a8-4ab1-846c-7220239273e2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:01.964411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d35058-13a8-4ab1-846c-7220239273e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:02.002881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-f7d35058-13a8-4ab1-846c-7220239273e2 None None] MFA Rules not processed for user `56017826d84f45e5b966db806fd7d3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:02.004135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f7d35058-13a8-4ab1-846c-7220239273e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:02.078215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1009/2011] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:02.084872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f304430-e442-4546-aba4-3cf467055f1e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:02.155670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f304430-e442-4546-aba4-3cf467055f1e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:02.172504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ce70f-8796-4684-af0a-edc050f5e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:02.173274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ce70f-8796-4684-af0a-edc050f5e768 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:02.173468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ce70f-8796-4684-af0a-edc050f5e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:02.173795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ce70f-8796-4684-af0a-edc050f5e768 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:02.174501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ce70f-8796-4684-af0a-edc050f5e768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:02.176514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ce70f-8796-4684-af0a-edc050f5e768 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:02.206861 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1003/2012] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:02 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:55:02.211302 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d35058-13a8-4ab1-846c-7220239273e2 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:02.223065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d35058-13a8-4ab1-846c-7220239273e2 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:02.296750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbdabd-ed93-4d48-8aa4-72b191bb5e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:02.297479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbdabd-ed93-4d48-8aa4-72b191bb5e58 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:02.297761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbdabd-ed93-4d48-8aa4-72b191bb5e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:02.298070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbdabd-ed93-4d48-8aa4-72b191bb5e58 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:02.298760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbdabd-ed93-4d48-8aa4-72b191bb5e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:02.300763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbdabd-ed93-4d48-8aa4-72b191bb5e58 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:02.329973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1010/2013] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:02 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:02.335888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ce70f-8796-4684-af0a-edc050f5e768 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:02.350645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ce70f-8796-4684-af0a-edc050f5e768 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:02.356560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ddc6d-f40c-4dd5-9f94-a9d1dd45b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:02.357252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ddc6d-f40c-4dd5-9f94-a9d1dd45b927 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:02.357536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ddc6d-f40c-4dd5-9f94-a9d1dd45b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:02.358022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ddc6d-f40c-4dd5-9f94-a9d1dd45b927 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:02.359135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ddc6d-f40c-4dd5-9f94-a9d1dd45b927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:02.360867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ddc6d-f40c-4dd5-9f94-a9d1dd45b927 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:02.372662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1004/2014] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:02.377589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbdabd-ed93-4d48-8aa4-72b191bb5e58 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:02.389521 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbdabd-ed93-4d48-8aa4-72b191bb5e58 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:02.395262 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b919-5001-4833-84ad-b2b0cc538d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:02.396139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b919-5001-4833-84ad-b2b0cc538d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:02.396433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b919-5001-4833-84ad-b2b0cc538d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:02.396692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7b919-5001-4833-84ad-b2b0cc538d36 admin admin] PATH_INFO: `/v3/projects/38b8223110c443c08af1c1c129968a7f/users/3a426ed4a6bd40c895d54594505278f4/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:02.413732 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7b919-5001-4833-84ad-b2b0cc538d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b8223110c443c08af1c1c129968a7f, user_id=3a426ed4a6bd40c895d54594505278f4, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:02.416506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7b919-5001-4833-84ad-b2b0cc538d36 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:02.433890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1011/2015] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:02 2022] PUT /identity/v3/projects/38b8223110c443c08af1c1c129968a7f/users/3a426ed4a6bd40c895d54594505278f4/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:02.440241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ddc6d-f40c-4dd5-9f94-a9d1dd45b927 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:02.469461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ddc6d-f40c-4dd5-9f94-a9d1dd45b927 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:02.579630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5786ba-9180-4fc9-9348-e5b0cbe2bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:02.580458 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5786ba-9180-4fc9-9348-e5b0cbe2bf3d admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:02.580740 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5786ba-9180-4fc9-9348-e5b0cbe2bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:02.581119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5786ba-9180-4fc9-9348-e5b0cbe2bf3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:02.582264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5786ba-9180-4fc9-9348-e5b0cbe2bf3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:02.585173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5786ba-9180-4fc9-9348-e5b0cbe2bf3d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:02.599779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1005/2016] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:02.604196 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b919-5001-4833-84ad-b2b0cc538d36 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:02.622844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7b919-5001-4833-84ad-b2b0cc538d36 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:02.629246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144bc85-8d88-445d-bddc-927085157455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:02.630808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144bc85-8d88-445d-bddc-927085157455 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:02.631175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144bc85-8d88-445d-bddc-927085157455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:02.631540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144bc85-8d88-445d-bddc-927085157455 admin admin] PATH_INFO: `/v3/projects/38b8223110c443c08af1c1c129968a7f/users/3a426ed4a6bd40c895d54594505278f4/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:02.633971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144bc85-8d88-445d-bddc-927085157455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b8223110c443c08af1c1c129968a7f, user_id=3a426ed4a6bd40c895d54594505278f4, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:02.638256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144bc85-8d88-445d-bddc-927085157455 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:02.668810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500b1cb-38be-4e34-8a3a-4cb916e00d47 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:02.669777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500b1cb-38be-4e34-8a3a-4cb916e00d47 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:02.670112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500b1cb-38be-4e34-8a3a-4cb916e00d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:02.671664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1012/2017] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:02 2022] PUT /identity/v3/projects/38b8223110c443c08af1c1c129968a7f/users/3a426ed4a6bd40c895d54594505278f4/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:02.708090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9500b1cb-38be-4e34-8a3a-4cb916e00d47 None None] MFA Rules not processed for user `3a426ed4a6bd40c895d54594505278f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:02.709711 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9500b1cb-38be-4e34-8a3a-4cb916e00d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:02.851791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144bc85-8d88-445d-bddc-927085157455 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:02.864687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e144bc85-8d88-445d-bddc-927085157455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:02.930192 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1006/2018] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:02.951968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500b1cb-38be-4e34-8a3a-4cb916e00d47 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:02.953619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9500b1cb-38be-4e34-8a3a-4cb916e00d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:02.998146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144bc85-8d88-445d-bddc-927085157455 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:03.006032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:03.008555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:03.009952 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:03.010618 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] PATH_INFO: `/v3/users/71fe62cbc9ef4b77a311ffb82cf250be` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:03.015417 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fe62cbc9ef4b77a311ffb82cf250be)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:03.018832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:03.062530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500b1cb-38be-4e34-8a3a-4cb916e00d47 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:03.068726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc83d4-fd01-4ab8-bc06-3fe9f4ea6d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:03.070073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc83d4-fd01-4ab8-bc06-3fe9f4ea6d7e service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:03.070567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc83d4-fd01-4ab8-bc06-3fe9f4ea6d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:03.071020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc83d4-fd01-4ab8-bc06-3fe9f4ea6d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:03.095453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fe62cbc9ef4b77a311ffb82cf250be'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:03.116354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fe62cbc9ef4b77a311ffb82cf250be'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:03.134924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fe62cbc9ef4b77a311ffb82cf250be'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:03.136381 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fe62cbc9ef4b77a311ffb82cf250be'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:03.157875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6b1a6246-e929-44ce-98d8-c6cd933232ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fe62cbc9ef4b77a311ffb82cf250be'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:03.167695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1013/2019] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:02 2022] DELETE /identity/v3/users/71fe62cbc9ef4b77a311ffb82cf250be => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:03.173832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62136cd4-90e1-4946-a085-e48787cdf23d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:03.175143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62136cd4-90e1-4946-a085-e48787cdf23d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:03.176298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62136cd4-90e1-4946-a085-e48787cdf23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:03.193059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc83d4-fd01-4ab8-bc06-3fe9f4ea6d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:03.195499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc83d4-fd01-4ab8-bc06-3fe9f4ea6d7e service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:03.209183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-62136cd4-90e1-4946-a085-e48787cdf23d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:03.209639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1007/2020] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:55:03.210635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-62136cd4-90e1-4946-a085-e48787cdf23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:03.319391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1014/2021] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:03.328428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc83d4-fd01-4ab8-bc06-3fe9f4ea6d7e service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:03.330629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-aedc83d4-fd01-4ab8-bc06-3fe9f4ea6d7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:03.449290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc83d4-fd01-4ab8-bc06-3fe9f4ea6d7e service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:03.549367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965063f7-7812-4f64-879b-31489f1963e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:03.551561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965063f7-7812-4f64-879b-31489f1963e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:03.552501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965063f7-7812-4f64-879b-31489f1963e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:03.552976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965063f7-7812-4f64-879b-31489f1963e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:03.569782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965063f7-7812-4f64-879b-31489f1963e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:03.572529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965063f7-7812-4f64-879b-31489f1963e9 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:03.591435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1008/2022] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:03.969441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62136cd4-90e1-4946-a085-e48787cdf23d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:03.972126 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-62136cd4-90e1-4946-a085-e48787cdf23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:03.999654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62136cd4-90e1-4946-a085-e48787cdf23d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.008669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.010312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.010799 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.011276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] PATH_INFO: `/v3/projects/40fcbec6818e485eb3be492d4db0a994` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.017338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fcbec6818e485eb3be492d4db0a994)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.021446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:04.084738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fcbec6818e485eb3be492d4db0a994', 'request_id': 'req-2dd733c4-80c8-43f3-9a1e-55b3521c3286'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:04.091219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fcbec6818e485eb3be492d4db0a994', 'request_id': 'req-2dd733c4-80c8-43f3-9a1e-55b3521c3286'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:04.101148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fcbec6818e485eb3be492d4db0a994', 'request_id': 'req-2dd733c4-80c8-43f3-9a1e-55b3521c3286'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:04.122050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] The token cache is being invalidate because project 40fcbec6818e485eb3be492d4db0a994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:04.122361 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:04.123233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2dd733c4-80c8-43f3-9a1e-55b3521c3286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:04.124801 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1015/2023] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:03 2022] DELETE /identity/v3/projects/40fcbec6818e485eb3be492d4db0a994 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:04.130136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea933f2-c9d3-4b37-8519-18fdfad109bc None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.130423 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea933f2-c9d3-4b37-8519-18fdfad109bc None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.130698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea933f2-c9d3-4b37-8519-18fdfad109bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.162596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8ea933f2-c9d3-4b37-8519-18fdfad109bc None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:04.163860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8ea933f2-c9d3-4b37-8519-18fdfad109bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:04.224649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1009/2024] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:04.232789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c455baa-51b1-4d61-9c74-3b657040e7a3 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.233076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c455baa-51b1-4d61-9c74-3b657040e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.233387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c455baa-51b1-4d61-9c74-3b657040e7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.254510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-5c455baa-51b1-4d61-9c74-3b657040e7a3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:04.255777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5c455baa-51b1-4d61-9c74-3b657040e7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:04.266833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1016/2025] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:04.271376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea933f2-c9d3-4b37-8519-18fdfad109bc None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:04.284797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea933f2-c9d3-4b37-8519-18fdfad109bc None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.291946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0fd22-6b7e-4805-b75d-090dc1d1a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.292610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fd22-6b7e-4805-b75d-090dc1d1a652 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.292888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fd22-6b7e-4805-b75d-090dc1d1a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.293158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0fd22-6b7e-4805-b75d-090dc1d1a652 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.293879 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0fd22-6b7e-4805-b75d-090dc1d1a652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:55:04.294218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0fd22-6b7e-4805-b75d-090dc1d1a652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.295838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0fd22-6b7e-4805-b75d-090dc1d1a652 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:04.308246 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1010/2026] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:55:04.312753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c455baa-51b1-4d61-9c74-3b657040e7a3 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:04.322278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c455baa-51b1-4d61-9c74-3b657040e7a3 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.328152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda6b0b-89a9-4532-812b-516ee4d2184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.328802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda6b0b-89a9-4532-812b-516ee4d2184d admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.329082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda6b0b-89a9-4532-812b-516ee4d2184d admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.329359 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda6b0b-89a9-4532-812b-516ee4d2184d admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.330092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda6b0b-89a9-4532-812b-516ee4d2184d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.332174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda6b0b-89a9-4532-812b-516ee4d2184d admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:04.361104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1017/2027] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:04 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:04.365908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0fd22-6b7e-4805-b75d-090dc1d1a652 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:04.376196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0fd22-6b7e-4805-b75d-090dc1d1a652 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.439787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ede8c-4e7c-403d-9df8-aa3ced02fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.440641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ede8c-4e7c-403d-9df8-aa3ced02fa1d admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.441036 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ede8c-4e7c-403d-9df8-aa3ced02fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.441343 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ede8c-4e7c-403d-9df8-aa3ced02fa1d admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.442175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ede8c-4e7c-403d-9df8-aa3ced02fa1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.444856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ede8c-4e7c-403d-9df8-aa3ced02fa1d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:04.475026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1011/2028] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:04 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:55:04.480028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda6b0b-89a9-4532-812b-516ee4d2184d admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:04.491097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda6b0b-89a9-4532-812b-516ee4d2184d admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.497317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c0be-02f9-45fe-887b-78c07a09e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.498010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c0be-02f9-45fe-887b-78c07a09e71a admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.498287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c0be-02f9-45fe-887b-78c07a09e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.498555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c0be-02f9-45fe-887b-78c07a09e71a admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.499274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4c0be-02f9-45fe-887b-78c07a09e71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.500887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4c0be-02f9-45fe-887b-78c07a09e71a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:04.514836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1018/2029] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:04.519097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ede8c-4e7c-403d-9df8-aa3ced02fa1d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:04.531301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ede8c-4e7c-403d-9df8-aa3ced02fa1d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.539432 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca77e2-9127-4c18-ad8b-9a8d3375960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.540183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca77e2-9127-4c18-ad8b-9a8d3375960d admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.540466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca77e2-9127-4c18-ad8b-9a8d3375960d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.540745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca77e2-9127-4c18-ad8b-9a8d3375960d admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.541696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca77e2-9127-4c18-ad8b-9a8d3375960d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.543496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca77e2-9127-4c18-ad8b-9a8d3375960d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:04.558166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1012/2030] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:04.562845 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c0be-02f9-45fe-887b-78c07a09e71a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:04.575232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c0be-02f9-45fe-887b-78c07a09e71a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.580374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ac79f-4b55-45ae-828e-b97f9bb3fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.581288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ac79f-4b55-45ae-828e-b97f9bb3fe8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.581565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ac79f-4b55-45ae-828e-b97f9bb3fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.581856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ac79f-4b55-45ae-828e-b97f9bb3fe8e admin admin] PATH_INFO: `/v3/projects/74ec9704de1a425f8cd5f59c107fb492/users/39430a9f747349df8c3c9ac617a11dfa/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.601918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ac79f-4b55-45ae-828e-b97f9bb3fe8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ec9704de1a425f8cd5f59c107fb492, user_id=39430a9f747349df8c3c9ac617a11dfa, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.605420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ac79f-4b55-45ae-828e-b97f9bb3fe8e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:04.625088 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1019/2031] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:04 2022] PUT /identity/v3/projects/74ec9704de1a425f8cd5f59c107fb492/users/39430a9f747349df8c3c9ac617a11dfa/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:04.638433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41105b4f-8890-4c00-a14f-202eebbec182 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.638792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41105b4f-8890-4c00-a14f-202eebbec182 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.639158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41105b4f-8890-4c00-a14f-202eebbec182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.671165 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-41105b4f-8890-4c00-a14f-202eebbec182 None None] MFA Rules not processed for user `39430a9f747349df8c3c9ac617a11dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:04.672529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-41105b4f-8890-4c00-a14f-202eebbec182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:04.748864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1013/2032] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:04.753033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ac79f-4b55-45ae-828e-b97f9bb3fe8e admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:04.816081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ac79f-4b55-45ae-828e-b97f9bb3fe8e admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.821477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e3ca-8afa-4b32-8568-627980ab85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.822310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e3ca-8afa-4b32-8568-627980ab85b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.822594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e3ca-8afa-4b32-8568-627980ab85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.822875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e3ca-8afa-4b32-8568-627980ab85b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.823610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075e3ca-8afa-4b32-8568-627980ab85b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.825551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075e3ca-8afa-4b32-8568-627980ab85b8 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:04.856087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1020/2033] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:04 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:04.861832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41105b4f-8890-4c00-a14f-202eebbec182 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:04.874790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41105b4f-8890-4c00-a14f-202eebbec182 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.941713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8b943-5e5e-4bd6-9ce3-7825e967cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.942478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b943-5e5e-4bd6-9ce3-7825e967cd1d admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.942761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b943-5e5e-4bd6-9ce3-7825e967cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.943041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b943-5e5e-4bd6-9ce3-7825e967cd1d admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.943741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8b943-5e5e-4bd6-9ce3-7825e967cd1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.945762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8b943-5e5e-4bd6-9ce3-7825e967cd1d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:04.969665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1014/2034] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:04 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:55:04.974177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e3ca-8afa-4b32-8568-627980ab85b8 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:04.985999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e3ca-8afa-4b32-8568-627980ab85b8 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:04.991867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46106b-7208-4852-82a9-0e3bb613c3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:04.992553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46106b-7208-4852-82a9-0e3bb613c3bc admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:04.992832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46106b-7208-4852-82a9-0e3bb613c3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:04.993099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46106b-7208-4852-82a9-0e3bb613c3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:04.994194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46106b-7208-4852-82a9-0e3bb613c3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:04.995773 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46106b-7208-4852-82a9-0e3bb613c3bc admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:05.007418 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1021/2035] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:05.011866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8b943-5e5e-4bd6-9ce3-7825e967cd1d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:05.021980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8b943-5e5e-4bd6-9ce3-7825e967cd1d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:05.027091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0099f37-4d6c-4a52-abb4-01cd51b4baae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:05.027760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0099f37-4d6c-4a52-abb4-01cd51b4baae admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.028052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0099f37-4d6c-4a52-abb4-01cd51b4baae admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.028376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0099f37-4d6c-4a52-abb4-01cd51b4baae admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.029124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0099f37-4d6c-4a52-abb4-01cd51b4baae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:05.030835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0099f37-4d6c-4a52-abb4-01cd51b4baae admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:05.044793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1015/2036] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:05.050969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46106b-7208-4852-82a9-0e3bb613c3bc admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:05.061376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46106b-7208-4852-82a9-0e3bb613c3bc admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:05.066485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de324d14-a59a-4e2d-a3cc-f9b435177f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:05.067449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de324d14-a59a-4e2d-a3cc-f9b435177f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.067727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de324d14-a59a-4e2d-a3cc-f9b435177f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.068001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de324d14-a59a-4e2d-a3cc-f9b435177f3d admin admin] PATH_INFO: `/v3/projects/c4f83e908df74d8d9bcb9b9d86844e3d/users/da35ece60722423a8fce197c11a6b851/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.084073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de324d14-a59a-4e2d-a3cc-f9b435177f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f83e908df74d8d9bcb9b9d86844e3d, user_id=da35ece60722423a8fce197c11a6b851, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:05.086850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de324d14-a59a-4e2d-a3cc-f9b435177f3d admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:05.101988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1022/2037] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:05 2022] PUT /identity/v3/projects/c4f83e908df74d8d9bcb9b9d86844e3d/users/da35ece60722423a8fce197c11a6b851/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:05.113010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e4ed0-cb6d-46ce-801f-c1d80ce971ae None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.113295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e4ed0-cb6d-46ce-801f-c1d80ce971ae None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.113570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e4ed0-cb6d-46ce-801f-c1d80ce971ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.145514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-f34e4ed0-cb6d-46ce-801f-c1d80ce971ae None None] MFA Rules not processed for user `da35ece60722423a8fce197c11a6b851`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:05.146820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f34e4ed0-cb6d-46ce-801f-c1d80ce971ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:05.236851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1016/2038] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:05.242035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de324d14-a59a-4e2d-a3cc-f9b435177f3d admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:05.347286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de324d14-a59a-4e2d-a3cc-f9b435177f3d admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:05.355667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196e250-50f9-43b3-9c1d-d3f73b0ab3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:05.356796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196e250-50f9-43b3-9c1d-d3f73b0ab3aa admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.357154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196e250-50f9-43b3-9c1d-d3f73b0ab3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.357427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196e250-50f9-43b3-9c1d-d3f73b0ab3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.359253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196e250-50f9-43b3-9c1d-d3f73b0ab3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:05.362387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196e250-50f9-43b3-9c1d-d3f73b0ab3aa admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:05.400355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1023/2039] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:05 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:05.404549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e4ed0-cb6d-46ce-801f-c1d80ce971ae None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:05.416978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e4ed0-cb6d-46ce-801f-c1d80ce971ae None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:05.479397 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db4363-8a4a-4bb6-92cd-55ba67eecd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:05.480154 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db4363-8a4a-4bb6-92cd-55ba67eecd58 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.480397 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db4363-8a4a-4bb6-92cd-55ba67eecd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.480675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db4363-8a4a-4bb6-92cd-55ba67eecd58 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.481394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db4363-8a4a-4bb6-92cd-55ba67eecd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:05.483464 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db4363-8a4a-4bb6-92cd-55ba67eecd58 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:05.507457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1017/2040] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:05 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:05.512837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196e250-50f9-43b3-9c1d-d3f73b0ab3aa admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:05.525382 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196e250-50f9-43b3-9c1d-d3f73b0ab3aa admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:05.530891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca5017-3133-4dbf-b537-7317bcbaeed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:05.531577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca5017-3133-4dbf-b537-7317bcbaeed5 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.531858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca5017-3133-4dbf-b537-7317bcbaeed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.532131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca5017-3133-4dbf-b537-7317bcbaeed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.532861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca5017-3133-4dbf-b537-7317bcbaeed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:05.534525 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca5017-3133-4dbf-b537-7317bcbaeed5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:05.549548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1024/2041] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:05.553885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db4363-8a4a-4bb6-92cd-55ba67eecd58 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:05.564765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db4363-8a4a-4bb6-92cd-55ba67eecd58 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:05.569715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c110d8-7e0b-4442-b7f2-5e7e030dbf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:05.570666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c110d8-7e0b-4442-b7f2-5e7e030dbf43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.570931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c110d8-7e0b-4442-b7f2-5e7e030dbf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.571203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c110d8-7e0b-4442-b7f2-5e7e030dbf43 admin admin] PATH_INFO: `/v3/projects/8d0e32168c744f95a8c528992a14a03b/users/98bb73f5942d4448a71cb5e666e86df2/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.588913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c110d8-7e0b-4442-b7f2-5e7e030dbf43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0e32168c744f95a8c528992a14a03b, user_id=98bb73f5942d4448a71cb5e666e86df2, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:05.592111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c110d8-7e0b-4442-b7f2-5e7e030dbf43 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:05.610799 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1018/2042] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:05 2022] PUT /identity/v3/projects/8d0e32168c744f95a8c528992a14a03b/users/98bb73f5942d4448a71cb5e666e86df2/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:05.614911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca5017-3133-4dbf-b537-7317bcbaeed5 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:05.626332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca5017-3133-4dbf-b537-7317bcbaeed5 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:05.696098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58de1b-c458-4b9f-8e20-0a6132290c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:05.697406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58de1b-c458-4b9f-8e20-0a6132290c88 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.697685 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58de1b-c458-4b9f-8e20-0a6132290c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.697966 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58de1b-c458-4b9f-8e20-0a6132290c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.698721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58de1b-c458-4b9f-8e20-0a6132290c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:05.700342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58de1b-c458-4b9f-8e20-0a6132290c88 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:05.715224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1025/2043] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:05.719886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c110d8-7e0b-4442-b7f2-5e7e030dbf43 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:05.736777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c110d8-7e0b-4442-b7f2-5e7e030dbf43 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:05.745721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb833a-0b5a-40bb-ae7c-659ccf379221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:05.746875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb833a-0b5a-40bb-ae7c-659ccf379221 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.747158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb833a-0b5a-40bb-ae7c-659ccf379221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.747460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb833a-0b5a-40bb-ae7c-659ccf379221 admin admin] PATH_INFO: `/v3/projects/8d0e32168c744f95a8c528992a14a03b/users/98bb73f5942d4448a71cb5e666e86df2/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.749871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb833a-0b5a-40bb-ae7c-659ccf379221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0e32168c744f95a8c528992a14a03b, user_id=98bb73f5942d4448a71cb5e666e86df2, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:05.752874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb833a-0b5a-40bb-ae7c-659ccf379221 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:05.765075 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1019/2044] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:05 2022] PUT /identity/v3/projects/8d0e32168c744f95a8c528992a14a03b/users/98bb73f5942d4448a71cb5e666e86df2/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:05.776170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea7e1-7513-46c7-9d1c-461db44a086c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.776600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea7e1-7513-46c7-9d1c-461db44a086c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.776947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea7e1-7513-46c7-9d1c-461db44a086c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:05.812286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d42ea7e1-7513-46c7-9d1c-461db44a086c None None] MFA Rules not processed for user `98bb73f5942d4448a71cb5e666e86df2`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:05.813584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d42ea7e1-7513-46c7-9d1c-461db44a086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:05.902020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1026/2045] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:05.913671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb833a-0b5a-40bb-ae7c-659ccf379221 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:05.915442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f1fb833a-0b5a-40bb-ae7c-659ccf379221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:05.982509 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb833a-0b5a-40bb-ae7c-659ccf379221 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:05.986523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb8ecb-a9d5-49b6-84d2-f78d8059da5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:05.987168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb8ecb-a9d5-49b6-84d2-f78d8059da5f service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:05.987446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb8ecb-a9d5-49b6-84d2-f78d8059da5f service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:05.987720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb8ecb-a9d5-49b6-84d2-f78d8059da5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:06.049821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb8ecb-a9d5-49b6-84d2-f78d8059da5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:06.051228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb8ecb-a9d5-49b6-84d2-f78d8059da5f service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:06.062235 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1020/2046] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:17.137067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ea7e1-7513-46c7-9d1c-461db44a086c None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:17.139273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d42ea7e1-7513-46c7-9d1c-461db44a086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:17.159638 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ea7e1-7513-46c7-9d1c-461db44a086c None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:17.166044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036bfb-5c94-48fc-872c-d4cf88bbc97d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:17.167126 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036bfb-5c94-48fc-872c-d4cf88bbc97d service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:17.167591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036bfb-5c94-48fc-872c-d4cf88bbc97d service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:17.167935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036bfb-5c94-48fc-872c-d4cf88bbc97d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:17.233560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17036bfb-5c94-48fc-872c-d4cf88bbc97d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:17.234972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17036bfb-5c94-48fc-872c-d4cf88bbc97d service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:17.245299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1027/2047] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:18.610092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb8ecb-a9d5-49b6-84d2-f78d8059da5f service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:18.619905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb8ecb-a9d5-49b6-84d2-f78d8059da5f service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:18.623647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a5ea-ef87-46e4-8182-8e28fd2f0515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:18.624692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a5ea-ef87-46e4-8182-8e28fd2f0515 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:18.624692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a5ea-ef87-46e4-8182-8e28fd2f0515 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:18.624893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a5ea-ef87-46e4-8182-8e28fd2f0515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:18.635216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591a5ea-ef87-46e4-8182-8e28fd2f0515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:18.637119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591a5ea-ef87-46e4-8182-8e28fd2f0515 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:18.653492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1021/2048] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:29.013753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036bfb-5c94-48fc-872c-d4cf88bbc97d service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:29.022974 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036bfb-5c94-48fc-872c-d4cf88bbc97d service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:29.027415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b67c4c-6717-420b-afa3-410accaf9fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:29.028087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b67c4c-6717-420b-afa3-410accaf9fbc service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:29.028384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b67c4c-6717-420b-afa3-410accaf9fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:29.028649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b67c4c-6717-420b-afa3-410accaf9fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:29.030515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-08b67c4c-6717-420b-afa3-410accaf9fbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:29.134365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b67c4c-6717-420b-afa3-410accaf9fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:29.136967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b67c4c-6717-420b-afa3-410accaf9fbc service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:29.153440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1028/2049] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:55:37.681860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a5ea-ef87-46e4-8182-8e28fd2f0515 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:37.682609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e591a5ea-ef87-46e4-8182-8e28fd2f0515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:37.883857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a5ea-ef87-46e4-8182-8e28fd2f0515 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:37.892754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:37.893888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:37.894399 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:37.894879 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] PATH_INFO: `/v3/users/fd00b72a6dda40f68f6c4ff53033c545` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:37.896935 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd00b72a6dda40f68f6c4ff53033c545)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:37.900713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:37.982210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd00b72a6dda40f68f6c4ff53033c545'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:37.983344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd00b72a6dda40f68f6c4ff53033c545'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:37.984398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd00b72a6dda40f68f6c4ff53033c545'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:37.996573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd00b72a6dda40f68f6c4ff53033c545'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.006588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd00b72a6dda40f68f6c4ff53033c545'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.036837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1022/2050] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:37 2022] DELETE /identity/v3/users/fd00b72a6dda40f68f6c4ff53033c545 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:38.042894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd9497-e04b-4837-9b23-e6c399115c03 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:38.043458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd9497-e04b-4837-9b23-e6c399115c03 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:38.043642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd9497-e04b-4837-9b23-e6c399115c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:38.068223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-3bbd9497-e04b-4837-9b23-e6c399115c03 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:38.069600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3bbd9497-e04b-4837-9b23-e6c399115c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:38.070915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:38.074816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:38.170520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1029/2051] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:38.172849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34371a7e-4485-4675-aa84-565b1b2abaa1 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:38.182737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd9497-e04b-4837-9b23-e6c399115c03 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:38.183540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:38.185092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:38.185316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-3bbd9497-e04b-4837-9b23-e6c399115c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:38.185589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:38.186129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] PATH_INFO: `/v3/users/5b36116b9d2d4a1785e1be23b434399c` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:38.188992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b36116b9d2d4a1785e1be23b434399c)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:38.192844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:38.264118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b36116b9d2d4a1785e1be23b434399c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.264862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b36116b9d2d4a1785e1be23b434399c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.270279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b36116b9d2d4a1785e1be23b434399c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.280207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b36116b9d2d4a1785e1be23b434399c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.291955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b36116b9d2d4a1785e1be23b434399c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.314790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1023/2052] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:38 2022] DELETE /identity/v3/users/5b36116b9d2d4a1785e1be23b434399c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:38.323217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd9497-e04b-4837-9b23-e6c399115c03 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:38.409547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433a48a-92c8-4309-adf9-748263cbfb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:38.410320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433a48a-92c8-4309-adf9-748263cbfb42 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:38.410643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433a48a-92c8-4309-adf9-748263cbfb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:38.410920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433a48a-92c8-4309-adf9-748263cbfb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:38.413728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d433a48a-92c8-4309-adf9-748263cbfb42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:38.512907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433a48a-92c8-4309-adf9-748263cbfb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:38.514604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433a48a-92c8-4309-adf9-748263cbfb42 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:38.526296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1030/2053] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:38.575520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:38.578831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:38.626566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9669a-1d30-476e-8692-f3b82ac86667 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:38.636246 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:38.639128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:38.639974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:38.641091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] PATH_INFO: `/v3/projects/17d755005b5c449193f2694d08939e92` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:38.644309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d755005b5c449193f2694d08939e92)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:38.648219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:38.723330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d755005b5c449193f2694d08939e92', 'request_id': 'req-13494f61-0b19-43f6-b11f-8a9de232e636'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.731476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d755005b5c449193f2694d08939e92', 'request_id': 'req-13494f61-0b19-43f6-b11f-8a9de232e636'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.740918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d755005b5c449193f2694d08939e92', 'request_id': 'req-13494f61-0b19-43f6-b11f-8a9de232e636'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.758311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] The token cache is being invalidate because project 17d755005b5c449193f2694d08939e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:38.759118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.759868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:38.761839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1024/2054] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:38 2022] DELETE /identity/v3/projects/17d755005b5c449193f2694d08939e92 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:38.769075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbfcd1-1333-4a1b-a63c-e13047e1902a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:38.770350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbfcd1-1333-4a1b-a63c-e13047e1902a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:38.770350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbfcd1-1333-4a1b-a63c-e13047e1902a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:38.791936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-ddfbfcd1-1333-4a1b-a63c-e13047e1902a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:38.794100 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ddfbfcd1-1333-4a1b-a63c-e13047e1902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:38.888931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:38.889300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1031/2055] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:38.891774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:38.897469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ceeeb-255e-41ff-88bc-610f38b23dd4 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:38.897771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ceeeb-255e-41ff-88bc-610f38b23dd4 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:38.898088 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ceeeb-255e-41ff-88bc-610f38b23dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:38.919007 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13494f61-0b19-43f6-b11f-8a9de232e636 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:38.925707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:38.927675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:38.928242 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-af0ceeeb-255e-41ff-88bc-610f38b23dd4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:38.928389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:38.929280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] PATH_INFO: `/v3/projects/288238156a5042e3a1db8693ba8df85c` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:38.931259 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-af0ceeeb-255e-41ff-88bc-610f38b23dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:38.932351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=288238156a5042e3a1db8693ba8df85c)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:38.938908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:38.947086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1032/2056] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:38.949299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ceeeb-255e-41ff-88bc-610f38b23dd4 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:38.966718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ceeeb-255e-41ff-88bc-610f38b23dd4 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:38.973929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cdfe1-1f9d-4eb4-abf0-58728a2942ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:38.974635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cdfe1-1f9d-4eb4-abf0-58728a2942ce admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:38.974913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cdfe1-1f9d-4eb4-abf0-58728a2942ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:38.975179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cdfe1-1f9d-4eb4-abf0-58728a2942ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:38.975922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cdfe1-1f9d-4eb4-abf0-58728a2942ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:55:38.976226 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cdfe1-1f9d-4eb4-abf0-58728a2942ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:38.978771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cdfe1-1f9d-4eb4-abf0-58728a2942ce admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.001987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1033/2057] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:55:39.005147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cdfe1-1f9d-4eb4-abf0-58728a2942ce admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.015791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cdfe1-1f9d-4eb4-abf0-58728a2942ce admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.019539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288238156a5042e3a1db8693ba8df85c', 'request_id': 'req-db0e4202-c763-4a13-b378-fef0076a50c9'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:39.025558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288238156a5042e3a1db8693ba8df85c', 'request_id': 'req-db0e4202-c763-4a13-b378-fef0076a50c9'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:39.031905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288238156a5042e3a1db8693ba8df85c', 'request_id': 'req-db0e4202-c763-4a13-b378-fef0076a50c9'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:39.045057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] The token cache is being invalidate because project 288238156a5042e3a1db8693ba8df85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:39.045344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:39.046127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-db0e4202-c763-4a13-b378-fef0076a50c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:39.047715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1025/2058] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:38 2022] DELETE /identity/v3/projects/288238156a5042e3a1db8693ba8df85c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:39.055374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ea4f7-9709-4657-aa8f-bc2ccaffe141 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.055767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ea4f7-9709-4657-aa8f-bc2ccaffe141 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.056055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ea4f7-9709-4657-aa8f-bc2ccaffe141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.076677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabdcfd-d88e-47a9-9c81-284a73383c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.077395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabdcfd-d88e-47a9-9c81-284a73383c1e admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.077615 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabdcfd-d88e-47a9-9c81-284a73383c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.077889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabdcfd-d88e-47a9-9c81-284a73383c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.078686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabdcfd-d88e-47a9-9c81-284a73383c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.078798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-993ea4f7-9709-4657-aa8f-bc2ccaffe141 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:39.080207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-993ea4f7-9709-4657-aa8f-bc2ccaffe141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:39.081575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabdcfd-d88e-47a9-9c81-284a73383c1e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.089339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1026/2059] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:39.098253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65560d44-fb5a-4d52-b9bd-4b0f8914c870 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.098520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65560d44-fb5a-4d52-b9bd-4b0f8914c870 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.098782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65560d44-fb5a-4d52-b9bd-4b0f8914c870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.111150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1034/2060] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:39 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:55:39.116221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabdcfd-d88e-47a9-9c81-284a73383c1e admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.118230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2dabdcfd-d88e-47a9-9c81-284a73383c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:39.125444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-65560d44-fb5a-4d52-b9bd-4b0f8914c870 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:39.127035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-65560d44-fb5a-4d52-b9bd-4b0f8914c870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:39.196603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabdcfd-d88e-47a9-9c81-284a73383c1e admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.201516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8839a-0465-4430-8164-c0e4c3a92d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.202235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8839a-0465-4430-8164-c0e4c3a92d70 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.202510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8839a-0465-4430-8164-c0e4c3a92d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.202780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8839a-0465-4430-8164-c0e4c3a92d70 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.203484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8839a-0465-4430-8164-c0e4c3a92d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.205442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8839a-0465-4430-8164-c0e4c3a92d70 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.213980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1027/2061] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:39.219174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65560d44-fb5a-4d52-b9bd-4b0f8914c870 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.230095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1035/2062] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:39 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:55:39.234318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65560d44-fb5a-4d52-b9bd-4b0f8914c870 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.234545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8839a-0465-4430-8164-c0e4c3a92d70 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.242568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeafb1-7c4b-4813-b7de-ea389f135595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.243749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeafb1-7c4b-4813-b7de-ea389f135595 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.244305 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeafb1-7c4b-4813-b7de-ea389f135595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.244771 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeafb1-7c4b-4813-b7de-ea389f135595 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.245600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8839a-0465-4430-8164-c0e4c3a92d70 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.246205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efeafb1-7c4b-4813-b7de-ea389f135595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:55:39.246741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efeafb1-7c4b-4813-b7de-ea389f135595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.249870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efeafb1-7c4b-4813-b7de-ea389f135595 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.252546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99766fb6-1943-41ec-b858-c6e08cd86340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.253660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766fb6-1943-41ec-b858-c6e08cd86340 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.254187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766fb6-1943-41ec-b858-c6e08cd86340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.254510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766fb6-1943-41ec-b858-c6e08cd86340 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.255629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99766fb6-1943-41ec-b858-c6e08cd86340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.257473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99766fb6-1943-41ec-b858-c6e08cd86340 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.266954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1028/2063] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:55:39.272262 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1036/2064] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:55:39.272748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeafb1-7c4b-4813-b7de-ea389f135595 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.273778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99766fb6-1943-41ec-b858-c6e08cd86340 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.284108 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeafb1-7c4b-4813-b7de-ea389f135595 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.285275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99766fb6-1943-41ec-b858-c6e08cd86340 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.289294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf8589-a302-432b-b9b9-651a87e4513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.290260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf8589-a302-432b-b9b9-651a87e4513f admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.290260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf8589-a302-432b-b9b9-651a87e4513f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.290528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf8589-a302-432b-b9b9-651a87e4513f admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.291272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf8589-a302-432b-b9b9-651a87e4513f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.291737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80d612-addf-4471-923f-525696923326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.292660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80d612-addf-4471-923f-525696923326 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.293151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80d612-addf-4471-923f-525696923326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.293675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80d612-addf-4471-923f-525696923326 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.293845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf8589-a302-432b-b9b9-651a87e4513f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.295077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80d612-addf-4471-923f-525696923326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.298170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80d612-addf-4471-923f-525696923326 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.317602 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1037/2065] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:55:39.325203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80d612-addf-4471-923f-525696923326 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.327744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1029/2066] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:39 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:55:39.334309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf8589-a302-432b-b9b9-651a87e4513f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.340153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80d612-addf-4471-923f-525696923326 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.412837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153a572-e71c-4ebe-ac5b-c9a181ad2650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.413808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153a572-e71c-4ebe-ac5b-c9a181ad2650 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.414209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153a572-e71c-4ebe-ac5b-c9a181ad2650 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.414635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153a572-e71c-4ebe-ac5b-c9a181ad2650 admin admin] PATH_INFO: `/v3/projects/5d18e0a0c78841f2aed89c8298906171/users/dc6e41197447403b9d424c1637d231aa/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.428284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf8589-a302-432b-b9b9-651a87e4513f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.438297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153a572-e71c-4ebe-ac5b-c9a181ad2650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d18e0a0c78841f2aed89c8298906171, user_id=dc6e41197447403b9d424c1637d231aa, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.439834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92165954-f6ff-4d00-8e7a-d292f9df593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.441135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92165954-f6ff-4d00-8e7a-d292f9df593a admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.441303 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153a572-e71c-4ebe-ac5b-c9a181ad2650 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.441644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92165954-f6ff-4d00-8e7a-d292f9df593a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.442201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92165954-f6ff-4d00-8e7a-d292f9df593a admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.443840 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92165954-f6ff-4d00-8e7a-d292f9df593a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.449805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92165954-f6ff-4d00-8e7a-d292f9df593a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.458929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1038/2067] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:39 2022] PUT /identity/v3/projects/5d18e0a0c78841f2aed89c8298906171/users/dc6e41197447403b9d424c1637d231aa/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:55:39.465213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d612d-4c1c-4828-90da-33ac5b43840a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.465894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d612d-4c1c-4828-90da-33ac5b43840a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.466468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d612d-4c1c-4828-90da-33ac5b43840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.490208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1030/2068] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:39 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:55:39.496839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92165954-f6ff-4d00-8e7a-d292f9df593a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.509603 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92165954-f6ff-4d00-8e7a-d292f9df593a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.526669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d97d612d-4c1c-4828-90da-33ac5b43840a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:39.528711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d97d612d-4c1c-4828-90da-33ac5b43840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:39.608019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410c142-0a3d-4663-96c9-0349780be0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.608785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410c142-0a3d-4663-96c9-0349780be0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.609074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410c142-0a3d-4663-96c9-0349780be0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.609634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410c142-0a3d-4663-96c9-0349780be0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.610144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410c142-0a3d-4663-96c9-0349780be0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.611988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410c142-0a3d-4663-96c9-0349780be0f6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.630540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1031/2069] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:39.631640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1039/2070] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:39.635621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410c142-0a3d-4663-96c9-0349780be0f6 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.646857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d612d-4c1c-4828-90da-33ac5b43840a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.648337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d97d612d-4c1c-4828-90da-33ac5b43840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:39.650738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410c142-0a3d-4663-96c9-0349780be0f6 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.656723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aeb29-8c3e-4659-abcd-83cd790750c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.657414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aeb29-8c3e-4659-abcd-83cd790750c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.657701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aeb29-8c3e-4659-abcd-83cd790750c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.657991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aeb29-8c3e-4659-abcd-83cd790750c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.658730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6aeb29-8c3e-4659-abcd-83cd790750c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.660467 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6aeb29-8c3e-4659-abcd-83cd790750c1 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.673444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1032/2071] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:55:39.677845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aeb29-8c3e-4659-abcd-83cd790750c1 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.691641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aeb29-8c3e-4659-abcd-83cd790750c1 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.697369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37964e33-4358-4360-9f56-ff758236862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.698601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37964e33-4358-4360-9f56-ff758236862f admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.698807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37964e33-4358-4360-9f56-ff758236862f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.698960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37964e33-4358-4360-9f56-ff758236862f admin admin] PATH_INFO: `/v3/projects/516b7b9385894affab50793ae382b7e2/users/c460c594b2c845ff88dcbdc5c6ad1edc/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.719226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37964e33-4358-4360-9f56-ff758236862f admin admin] RBAC: Authorizing `identity:create_grant(project_id=516b7b9385894affab50793ae382b7e2, user_id=c460c594b2c845ff88dcbdc5c6ad1edc, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.724756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37964e33-4358-4360-9f56-ff758236862f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.728515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d612d-4c1c-4828-90da-33ac5b43840a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:39.732264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbd988-f377-4aef-b4de-4ecdb2d623f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:39.732922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbd988-f377-4aef-b4de-4ecdb2d623f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.733207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbd988-f377-4aef-b4de-4ecdb2d623f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.733482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbd988-f377-4aef-b4de-4ecdb2d623f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.745437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbd988-f377-4aef-b4de-4ecdb2d623f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:39.745721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1033/2072] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:39 2022] PUT /identity/v3/projects/516b7b9385894affab50793ae382b7e2/users/c460c594b2c845ff88dcbdc5c6ad1edc/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:55:39.747476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbd988-f377-4aef-b4de-4ecdb2d623f5 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:39.752475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db006a89-6bb9-4676-bf20-eb1dcc249d7b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:39.752928 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db006a89-6bb9-4676-bf20-eb1dcc249d7b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:39.753405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db006a89-6bb9-4676-bf20-eb1dcc249d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:39.762393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1040/2073] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:55:39.778340 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-db006a89-6bb9-4676-bf20-eb1dcc249d7b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:39.779627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-db006a89-6bb9-4676-bf20-eb1dcc249d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:39.883754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1034/2074] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:39.896881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbd988-f377-4aef-b4de-4ecdb2d623f5 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:39.900398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2cfbd988-f377-4aef-b4de-4ecdb2d623f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:39.913867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbd988-f377-4aef-b4de-4ecdb2d623f5 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:40.002601 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53f99a-db74-43b7-8f2a-7bf436d5f14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:40.003748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53f99a-db74-43b7-8f2a-7bf436d5f14f service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:40.004250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53f99a-db74-43b7-8f2a-7bf436d5f14f service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:40.004694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53f99a-db74-43b7-8f2a-7bf436d5f14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:40.024556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53f99a-db74-43b7-8f2a-7bf436d5f14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:40.027482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53f99a-db74-43b7-8f2a-7bf436d5f14f service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:40.046934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1041/2075] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:45.036871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db006a89-6bb9-4676-bf20-eb1dcc249d7b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:45.038457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-db006a89-6bb9-4676-bf20-eb1dcc249d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:45.068833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db006a89-6bb9-4676-bf20-eb1dcc249d7b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:45.101102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:45.105598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:45.105909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:45.108903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] PATH_INFO: `/v3/users/55e2d8f744414df69e90b09e3bda414e` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:45.114924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e2d8f744414df69e90b09e3bda414e)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:45.124975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:45.261796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e2d8f744414df69e90b09e3bda414e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.262618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e2d8f744414df69e90b09e3bda414e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.263299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e2d8f744414df69e90b09e3bda414e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.283237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e2d8f744414df69e90b09e3bda414e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.293852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e2d8f744414df69e90b09e3bda414e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.329408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1035/2076] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:45 2022] DELETE /identity/v3/users/55e2d8f744414df69e90b09e3bda414e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:45.334792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8ee6e-4a29-4916-bcfd-6e427cea46f0 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:45.335815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8ee6e-4a29-4916-bcfd-6e427cea46f0 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:45.336243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8ee6e-4a29-4916-bcfd-6e427cea46f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:45.416580 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:45.418147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:45.426117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-99b8ee6e-4a29-4916-bcfd-6e427cea46f0 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:45.439812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-99b8ee6e-4a29-4916-bcfd-6e427cea46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:45.598598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc2b0b-78d8-4ec8-9ce6-07fb7f57135e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:45.625870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:45.626845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:45.627127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:45.627400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] PATH_INFO: `/v3/users/39430a9f747349df8c3c9ac617a11dfa` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:45.630958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39430a9f747349df8c3c9ac617a11dfa)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:45.633061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:45.658651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1042/2077] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:45.712739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39430a9f747349df8c3c9ac617a11dfa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.713723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39430a9f747349df8c3c9ac617a11dfa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.714698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39430a9f747349df8c3c9ac617a11dfa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.726674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39430a9f747349df8c3c9ac617a11dfa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.736693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-987ee503-bf00-486e-baf5-4e19ec80a97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39430a9f747349df8c3c9ac617a11dfa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:45.752488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8ee6e-4a29-4916-bcfd-6e427cea46f0 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:45.754294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-99b8ee6e-4a29-4916-bcfd-6e427cea46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:45.799026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1036/2078] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:45 2022] DELETE /identity/v3/users/39430a9f747349df8c3c9ac617a11dfa => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:55:45.800724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43d25-f797-43ba-a572-f2e0f6d08d22 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:45.801008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43d25-f797-43ba-a572-f2e0f6d08d22 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:45.801978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43d25-f797-43ba-a572-f2e0f6d08d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:45.848824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-5ae43d25-f797-43ba-a572-f2e0f6d08d22 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:45.852024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5ae43d25-f797-43ba-a572-f2e0f6d08d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:45.953306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8ee6e-4a29-4916-bcfd-6e427cea46f0 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:46.043899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1037/2079] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:46.070214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43d25-f797-43ba-a572-f2e0f6d08d22 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:46.071851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5ae43d25-f797-43ba-a572-f2e0f6d08d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:46.101518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:46.102918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:46.104232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:46.105000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:46.108606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:46.134687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:46.139332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:46.159681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1043/2080] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:55:46.195372 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43d25-f797-43ba-a572-f2e0f6d08d22 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:46.202431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c3215-9ed1-43b3-8f8b-4f04405d8dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:46.205840 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c3215-9ed1-43b3-8f8b-4f04405d8dee service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:46.206770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c3215-9ed1-43b3-8f8b-4f04405d8dee service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:46.207379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c3215-9ed1-43b3-8f8b-4f04405d8dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:46.231729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c3215-9ed1-43b3-8f8b-4f04405d8dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:46.235602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c3215-9ed1-43b3-8f8b-4f04405d8dee service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:46.252505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1038/2081] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:55:47.067600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:47.072567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:47.110584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ba7c-8e00-41f0-ab2a-c03173881556 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:47.140396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:47.145756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:47.146302 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:47.148914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] PATH_INFO: `/v3/projects/94d836876c9e4f7d826977f66ee49239` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:47.153752 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d836876c9e4f7d826977f66ee49239)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:47.156418 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:47.267698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5765cbd-e186-45ad-a793-530d41bbf68c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:47.270696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5765cbd-e186-45ad-a793-530d41bbf68c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:47.272085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5765cbd-e186-45ad-a793-530d41bbf68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:47.339992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d836876c9e4f7d826977f66ee49239', 'request_id': 'req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.349922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d836876c9e4f7d826977f66ee49239', 'request_id': 'req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.379736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b5765cbd-e186-45ad-a793-530d41bbf68c None None] MFA Rules not processed for user `dc6e41197447403b9d424c1637d231aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:47.389151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b5765cbd-e186-45ad-a793-530d41bbf68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:47.391118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d836876c9e4f7d826977f66ee49239', 'request_id': 'req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.447049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] The token cache is being invalidate because project 94d836876c9e4f7d826977f66ee49239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:47.453630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.462900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.470187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1044/2082] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:47 2022] DELETE /identity/v3/projects/94d836876c9e4f7d826977f66ee49239 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:47.473539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:47.483965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:47.656447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1039/2083] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:47.658437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5765cbd-e186-45ad-a793-530d41bbf68c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:47.684750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4fec1-bbf8-46e9-9018-3cb145ae5e49 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:47.685452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b5765cbd-e186-45ad-a793-530d41bbf68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:47.692368 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:47.693588 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:47.693876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:47.694221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] PATH_INFO: `/v3/projects/74ec9704de1a425f8cd5f59c107fb492` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:47.696389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ec9704de1a425f8cd5f59c107fb492)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:47.698606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:47.758101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5765cbd-e186-45ad-a793-530d41bbf68c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:47.770959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ec9704de1a425f8cd5f59c107fb492', 'request_id': 'req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.778864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ec9704de1a425f8cd5f59c107fb492', 'request_id': 'req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.802662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ec9704de1a425f8cd5f59c107fb492', 'request_id': 'req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.826093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] The token cache is being invalidate because project 74ec9704de1a425f8cd5f59c107fb492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:47.826672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.827565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:47.830656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1045/2084] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:47 2022] DELETE /identity/v3/projects/74ec9704de1a425f8cd5f59c107fb492 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:47.831894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:47.833600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:47.995758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:47.996761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:48.002451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7546c7-ec99-4cb9-afaa-b4a9345bc911 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:48.004283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:48.004891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] PATH_INFO: `/v3/users/a0f276b83bae4d7ab87450b9c31a7547` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:48.006686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f276b83bae4d7ab87450b9c31a7547)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:48.009178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:48.010429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:48.011225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:48.011611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:48.011984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:48.016168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:48.127849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:48.133834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:48.144781 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f276b83bae4d7ab87450b9c31a7547'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.146267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f276b83bae4d7ab87450b9c31a7547'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.149563 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f276b83bae4d7ab87450b9c31a7547'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.163814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f276b83bae4d7ab87450b9c31a7547'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.170522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1046/2085] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:48.172243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:48.177002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f276b83bae4d7ab87450b9c31a7547'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.183155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:48.214461 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48cee-c502-4e4f-85dc-6e79755d56d9 service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:48.222918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:48.224284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:48.224710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:48.225165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] PATH_INFO: `/v3/users/da35ece60722423a8fce197c11a6b851` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:48.230900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1040/2086] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:47 2022] DELETE /identity/v3/users/a0f276b83bae4d7ab87450b9c31a7547 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:48.233339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da35ece60722423a8fce197c11a6b851)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:48.244968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:48.365300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da35ece60722423a8fce197c11a6b851'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.403507 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da35ece60722423a8fce197c11a6b851'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.418645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da35ece60722423a8fce197c11a6b851'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.419805 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da35ece60722423a8fce197c11a6b851'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.438792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-de573ca3-de6e-4c90-a9c6-d918751e4b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da35ece60722423a8fce197c11a6b851'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:48.452386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1047/2087] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:48 2022] DELETE /identity/v3/users/da35ece60722423a8fce197c11a6b851 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:49.014755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:49.017359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:49.151611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b7d7-d51e-450b-96ee-909536ad29d7 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:49.152450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b7d7-d51e-450b-96ee-909536ad29d7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:49.152450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b7d7-d51e-450b-96ee-909536ad29d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:49.214410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4f03b7d7-d51e-450b-96ee-909536ad29d7 None None] MFA Rules not processed for user `c460c594b2c845ff88dcbdc5c6ad1edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:49.215838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4f03b7d7-d51e-450b-96ee-909536ad29d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:49.239764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d02ccb-32be-4f8f-aeab-6d8dd71bcc8f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:49.376674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1048/2088] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:55:49.379477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b7d7-d51e-450b-96ee-909536ad29d7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:49.385191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4f03b7d7-d51e-450b-96ee-909536ad29d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:49.399009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:49.400023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:49.400367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:49.400705 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] PATH_INFO: `/v3/projects/1b758948ee0d42d28a99eefbe72308ba` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:49.402282 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b758948ee0d42d28a99eefbe72308ba)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:49.404723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:49.519488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b758948ee0d42d28a99eefbe72308ba', 'request_id': 'req-ba940d6c-2aa1-4791-a968-9b57160fd1bb'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.532682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b758948ee0d42d28a99eefbe72308ba', 'request_id': 'req-ba940d6c-2aa1-4791-a968-9b57160fd1bb'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.548413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b758948ee0d42d28a99eefbe72308ba', 'request_id': 'req-ba940d6c-2aa1-4791-a968-9b57160fd1bb'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.572054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b7d7-d51e-450b-96ee-909536ad29d7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:49.591258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] The token cache is being invalidate because project 1b758948ee0d42d28a99eefbe72308ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:49.591258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.591258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.593019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1041/2089] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:49 2022] DELETE /identity/v3/projects/1b758948ee0d42d28a99eefbe72308ba => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:49.593882 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:49.598374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:49.712770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:49.715233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:49.715646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:49.716087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] PATH_INFO: `/v3/projects/c4f83e908df74d8d9bcb9b9d86844e3d` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:49.720549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f83e908df74d8d9bcb9b9d86844e3d)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:49.726701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:49.737143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba940d6c-2aa1-4791-a968-9b57160fd1bb admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:49.745968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70798f7-848f-4044-ae44-b39ffac89256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:49.747189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70798f7-848f-4044-ae44-b39ffac89256 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:49.747637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70798f7-848f-4044-ae44-b39ffac89256 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:49.748092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70798f7-848f-4044-ae44-b39ffac89256 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:49.749531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70798f7-848f-4044-ae44-b39ffac89256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:49.753193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70798f7-848f-4044-ae44-b39ffac89256 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:49.837579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f83e908df74d8d9bcb9b9d86844e3d', 'request_id': 'req-e932fa49-3a77-4529-a6da-3e9d42f7173c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.843674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1042/2090] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:49 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:49.847132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94948e4e-bff3-454a-bc73-62a60736aaa2 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:49.847955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94948e4e-bff3-454a-bc73-62a60736aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:49.848497 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94948e4e-bff3-454a-bc73-62a60736aaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:49.857566 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f83e908df74d8d9bcb9b9d86844e3d', 'request_id': 'req-e932fa49-3a77-4529-a6da-3e9d42f7173c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.876394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f83e908df74d8d9bcb9b9d86844e3d', 'request_id': 'req-e932fa49-3a77-4529-a6da-3e9d42f7173c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.907595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] The token cache is being invalidate because project c4f83e908df74d8d9bcb9b9d86844e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:49.907895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.911681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:49.914136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1049/2091] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:49 2022] DELETE /identity/v3/projects/c4f83e908df74d8d9bcb9b9d86844e3d => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:49.916514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:49.919377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:49.978572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-94948e4e-bff3-454a-bc73-62a60736aaa2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:49.980005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-94948e4e-bff3-454a-bc73-62a60736aaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:50.129998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1043/2092] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:50.129998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94948e4e-bff3-454a-bc73-62a60736aaa2 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:50.129998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-94948e4e-bff3-454a-bc73-62a60736aaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:50.131311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932fa49-3a77-4529-a6da-3e9d42f7173c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:50.134386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f03a6-4d29-4731-9fec-61a4b8e4275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:50.136191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f03a6-4d29-4731-9fec-61a4b8e4275a admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:50.136729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f03a6-4d29-4731-9fec-61a4b8e4275a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:50.137375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f03a6-4d29-4731-9fec-61a4b8e4275a admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:50.139130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f03a6-4d29-4731-9fec-61a4b8e4275a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:50.149316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f03a6-4d29-4731-9fec-61a4b8e4275a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:50.154939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94948e4e-bff3-454a-bc73-62a60736aaa2 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:50.166864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:50.168977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:50.170598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:50.171395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] PATH_INFO: `/v3/users/98bb73f5942d4448a71cb5e666e86df2` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:50.175700 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] RBAC: Authorizing `identity:delete_user(user_id=98bb73f5942d4448a71cb5e666e86df2)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:50.182694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:50.238066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1050/2093] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:49 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:50.240728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6efc5-bea0-4955-8e3c-9f6d97a4692b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:50.241221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6efc5-bea0-4955-8e3c-9f6d97a4692b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:50.241694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6efc5-bea0-4955-8e3c-9f6d97a4692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:50.280945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-5ee6efc5-bea0-4955-8e3c-9f6d97a4692b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:50.282757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5ee6efc5-bea0-4955-8e3c-9f6d97a4692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:50.293500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1051/2094] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:50.293500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6efc5-bea0-4955-8e3c-9f6d97a4692b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:50.308796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6efc5-bea0-4955-8e3c-9f6d97a4692b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:50.315234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46597-ea99-48fe-bcfd-e0edcd3a8711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:50.315931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46597-ea99-48fe-bcfd-e0edcd3a8711 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:50.316262 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46597-ea99-48fe-bcfd-e0edcd3a8711 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:50.316542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46597-ea99-48fe-bcfd-e0edcd3a8711 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:50.317326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b46597-ea99-48fe-bcfd-e0edcd3a8711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:50.319106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b46597-ea99-48fe-bcfd-e0edcd3a8711 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:50.335174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1052/2095] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:50.335901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46597-ea99-48fe-bcfd-e0edcd3a8711 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:50.347547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46597-ea99-48fe-bcfd-e0edcd3a8711 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:50.352691 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:50.353380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:50.353666 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:50.353969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:50.354786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:55:50.355094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:50.356756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:50.364705 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98bb73f5942d4448a71cb5e666e86df2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:50.365650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98bb73f5942d4448a71cb5e666e86df2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:50.366826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98bb73f5942d4448a71cb5e666e86df2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:50.370870 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1053/2096] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:55:50.371734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:50.382159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:50.386400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98bb73f5942d4448a71cb5e666e86df2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:50.402334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98bb73f5942d4448a71cb5e666e86df2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:50.407433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e7455-81f2-4734-ad5c-51767c2d5f9d admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:50.422390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b95e7-886e-4296-ae30-17ce2d3526d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:50.423832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b95e7-886e-4296-ae30-17ce2d3526d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:50.424475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b95e7-886e-4296-ae30-17ce2d3526d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:50.424946 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b95e7-886e-4296-ae30-17ce2d3526d6 admin admin] PATH_INFO: `/v3/projects/c05aeb90e99a4d7584808e08b956030b/users/d34d73f6eda24d9ca604ab9c14ab0509/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:50.473054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b95e7-886e-4296-ae30-17ce2d3526d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05aeb90e99a4d7584808e08b956030b, user_id=d34d73f6eda24d9ca604ab9c14ab0509, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:50.479977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b95e7-886e-4296-ae30-17ce2d3526d6 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:50.480968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1044/2097] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:50 2022] DELETE /identity/v3/users/98bb73f5942d4448a71cb5e666e86df2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:50.483097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:50.486278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:50.512274 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1054/2098] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:50 2022] PUT /identity/v3/projects/c05aeb90e99a4d7584808e08b956030b/users/d34d73f6eda24d9ca604ab9c14ab0509/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:50.518565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b95e7-886e-4296-ae30-17ce2d3526d6 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:50.691792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b95e7-886e-4296-ae30-17ce2d3526d6 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:50.702614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13849cf-a9a7-430e-ad27-491e010e409a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:50.717853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da901e-2d60-4046-8e7b-4b7981cde422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:50.720505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da901e-2d60-4046-8e7b-4b7981cde422 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:50.720988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da901e-2d60-4046-8e7b-4b7981cde422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:50.721457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da901e-2d60-4046-8e7b-4b7981cde422 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:50.722192 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ff178-7e6f-41d5-b294-a083c0abe30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:50.722866 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da901e-2d60-4046-8e7b-4b7981cde422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:50.723595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ff178-7e6f-41d5-b294-a083c0abe30c admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:50.724375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ff178-7e6f-41d5-b294-a083c0abe30c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:50.724978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ff178-7e6f-41d5-b294-a083c0abe30c admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:50.725781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da901e-2d60-4046-8e7b-4b7981cde422 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:50.729308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ff178-7e6f-41d5-b294-a083c0abe30c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:50.734487 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ff178-7e6f-41d5-b294-a083c0abe30c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:50.756157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1055/2099] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:50.756912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da901e-2d60-4046-8e7b-4b7981cde422 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:50.794795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da901e-2d60-4046-8e7b-4b7981cde422 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:50.815346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498278-df6c-4847-98ae-b71d50b6cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:50.816910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498278-df6c-4847-98ae-b71d50b6cead admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:50.817386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498278-df6c-4847-98ae-b71d50b6cead admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:50.817843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498278-df6c-4847-98ae-b71d50b6cead admin admin] PATH_INFO: `/v3/projects/c05aeb90e99a4d7584808e08b956030b/users/d34d73f6eda24d9ca604ab9c14ab0509/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:50.825858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1045/2100] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:50 2022] POST /identity/v3/projects => generated 369 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:50.832698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ff178-7e6f-41d5-b294-a083c0abe30c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:50.851233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5498278-df6c-4847-98ae-b71d50b6cead admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05aeb90e99a4d7584808e08b956030b, user_id=d34d73f6eda24d9ca604ab9c14ab0509, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:50.856688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5498278-df6c-4847-98ae-b71d50b6cead admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:50.881432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1056/2101] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:50 2022] PUT /identity/v3/projects/c05aeb90e99a4d7584808e08b956030b/users/d34d73f6eda24d9ca604ab9c14ab0509/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:51.062913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ff178-7e6f-41d5-b294-a083c0abe30c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:51.255740 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6fc36-052d-4609-a664-91e019cc36e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:51.257022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6fc36-052d-4609-a664-91e019cc36e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:51.258555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6fc36-052d-4609-a664-91e019cc36e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:51.259626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6fc36-052d-4609-a664-91e019cc36e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:51.261835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6fc36-052d-4609-a664-91e019cc36e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:51.266864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6fc36-052d-4609-a664-91e019cc36e2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:51.367182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1046/2102] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:50 2022] POST /identity/v3/users => generated 285 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:51.372686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498278-df6c-4847-98ae-b71d50b6cead admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:51.383394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6fc36-052d-4609-a664-91e019cc36e2 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:51.391201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-83f6fc36-052d-4609-a664-91e019cc36e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:51.391996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498278-df6c-4847-98ae-b71d50b6cead admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:51.425980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6fc36-052d-4609-a664-91e019cc36e2 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:51.431584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:51.432849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:51.433419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:51.434657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] PATH_INFO: `/v3/projects/8d0e32168c744f95a8c528992a14a03b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:51.436625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0e32168c744f95a8c528992a14a03b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:51.439745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:51.449921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaf19b-b1b1-4db5-b45e-7a90c3a1446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:51.451956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaf19b-b1b1-4db5-b45e-7a90c3a1446f admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:51.457453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaf19b-b1b1-4db5-b45e-7a90c3a1446f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:51.459565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaf19b-b1b1-4db5-b45e-7a90c3a1446f admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:51.468441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaf19b-b1b1-4db5-b45e-7a90c3a1446f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:51.480220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaf19b-b1b1-4db5-b45e-7a90c3a1446f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:51.512029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1057/2103] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:51.517220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaf19b-b1b1-4db5-b45e-7a90c3a1446f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:51.555976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaf19b-b1b1-4db5-b45e-7a90c3a1446f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:51.559981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0e32168c744f95a8c528992a14a03b', 'request_id': 'req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:51.602817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0e32168c744f95a8c528992a14a03b', 'request_id': 'req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:51.628729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0e32168c744f95a8c528992a14a03b', 'request_id': 'req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:51.684187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] The token cache is being invalidate because project 8d0e32168c744f95a8c528992a14a03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:55:51.684616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:51.688442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:51.711020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1047/2104] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:55:51 2022] DELETE /identity/v3/projects/8d0e32168c744f95a8c528992a14a03b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:55:51.786863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e1070-d081-4d1e-ae87-0d376f104629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:51.789670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1070-d081-4d1e-ae87-0d376f104629 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:51.789670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1070-d081-4d1e-ae87-0d376f104629 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:51.789670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1070-d081-4d1e-ae87-0d376f104629 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:51.791450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e1070-d081-4d1e-ae87-0d376f104629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:51.795272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e1070-d081-4d1e-ae87-0d376f104629 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:51.819498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1058/2105] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:51.820955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:51.822558 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:51.854459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaee16d-3ae3-4628-ae72-cff93b2e7f3d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:51.881551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533ef35-a3f3-4343-a476-b1eb5aa8379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:51.886581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533ef35-a3f3-4343-a476-b1eb5aa8379d admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:51.886581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533ef35-a3f3-4343-a476-b1eb5aa8379d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:51.887020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533ef35-a3f3-4343-a476-b1eb5aa8379d admin admin] PATH_INFO: `/v3/projects/da1537720b374439a97bd7b50b1ad49d/users/f7a2c8b02f8a4b4fb4f687701b795889/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:51.962304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533ef35-a3f3-4343-a476-b1eb5aa8379d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1537720b374439a97bd7b50b1ad49d, user_id=f7a2c8b02f8a4b4fb4f687701b795889, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:51.978186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533ef35-a3f3-4343-a476-b1eb5aa8379d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:52.021220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1048/2106] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:51 2022] PUT /identity/v3/projects/da1537720b374439a97bd7b50b1ad49d/users/f7a2c8b02f8a4b4fb4f687701b795889/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:52.047621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68370ee5-bba4-44f5-a0eb-d0a7950cab3d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:52.047621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68370ee5-bba4-44f5-a0eb-d0a7950cab3d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:52.047621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68370ee5-bba4-44f5-a0eb-d0a7950cab3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:52.108772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-68370ee5-bba4-44f5-a0eb-d0a7950cab3d None None] MFA Rules not processed for user `f7a2c8b02f8a4b4fb4f687701b795889`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:52.110178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-68370ee5-bba4-44f5-a0eb-d0a7950cab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:52.260109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1059/2107] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:52.265919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533ef35-a3f3-4343-a476-b1eb5aa8379d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:52.397473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533ef35-a3f3-4343-a476-b1eb5aa8379d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:52.410251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee9805-82e0-4de5-9c80-04ed3382a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:52.411080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee9805-82e0-4de5-9c80-04ed3382a1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:52.411376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee9805-82e0-4de5-9c80-04ed3382a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:52.411979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee9805-82e0-4de5-9c80-04ed3382a1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:52.412722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee9805-82e0-4de5-9c80-04ed3382a1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:52.422765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee9805-82e0-4de5-9c80-04ed3382a1c4 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:52.461420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1049/2108] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:55:52 2022] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:52.467951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68370ee5-bba4-44f5-a0eb-d0a7950cab3d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:52.486745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68370ee5-bba4-44f5-a0eb-d0a7950cab3d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:52.566864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246140e-bbe3-417d-9945-f2bc547adf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:52.567958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246140e-bbe3-417d-9945-f2bc547adf99 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:52.568473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246140e-bbe3-417d-9945-f2bc547adf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:52.568959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246140e-bbe3-417d-9945-f2bc547adf99 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:52.570208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246140e-bbe3-417d-9945-f2bc547adf99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:52.572740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246140e-bbe3-417d-9945-f2bc547adf99 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:52.607286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1060/2109] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:55:52 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:55:52.611046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee9805-82e0-4de5-9c80-04ed3382a1c4 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:52.626218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee9805-82e0-4de5-9c80-04ed3382a1c4 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:52.633033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f27af4-c2ea-4bce-87b1-ec5cb05ffbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:52.635215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27af4-c2ea-4bce-87b1-ec5cb05ffbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:52.635830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27af4-c2ea-4bce-87b1-ec5cb05ffbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:52.636325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27af4-c2ea-4bce-87b1-ec5cb05ffbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:52.641252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f27af4-c2ea-4bce-87b1-ec5cb05ffbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:52.643922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f27af4-c2ea-4bce-87b1-ec5cb05ffbd7 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:52.669442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246140e-bbe3-417d-9945-f2bc547adf99 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:52.680627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1050/2110] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:55:52.686697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246140e-bbe3-417d-9945-f2bc547adf99 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:52.701236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e42dc-d590-4d73-b856-bc8cfc00c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:52.703585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e42dc-d590-4d73-b856-bc8cfc00c34d admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:52.704237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e42dc-d590-4d73-b856-bc8cfc00c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:52.704984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e42dc-d590-4d73-b856-bc8cfc00c34d admin admin] PATH_INFO: `/v3/projects/6de28696164d4ab499eb89417aa330d3/users/355869e4e6374d58897d6ff8c205a28e/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:52.740731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e42dc-d590-4d73-b856-bc8cfc00c34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de28696164d4ab499eb89417aa330d3, user_id=355869e4e6374d58897d6ff8c205a28e, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:52.758601 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e42dc-d590-4d73-b856-bc8cfc00c34d admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:52.784804 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1061/2111] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:52 2022] PUT /identity/v3/projects/6de28696164d4ab499eb89417aa330d3/users/355869e4e6374d58897d6ff8c205a28e/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:52.786095 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f27af4-c2ea-4bce-87b1-ec5cb05ffbd7 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:52.820578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f27af4-c2ea-4bce-87b1-ec5cb05ffbd7 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:52.865721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736a33-09ad-4437-a241-626d1d20cbd5 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:52.866336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736a33-09ad-4437-a241-626d1d20cbd5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:52.866831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736a33-09ad-4437-a241-626d1d20cbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:52.905737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-31736a33-09ad-4437-a241-626d1d20cbd5 None None] MFA Rules not processed for user `dc6e41197447403b9d424c1637d231aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:52.907838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-31736a33-09ad-4437-a241-626d1d20cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:52.970920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9e892-c00f-4c2d-b9b4-f3f9b6799658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:52.972129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9e892-c00f-4c2d-b9b4-f3f9b6799658 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:52.972442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9e892-c00f-4c2d-b9b4-f3f9b6799658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:52.972890 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9e892-c00f-4c2d-b9b4-f3f9b6799658 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:52.973637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9e892-c00f-4c2d-b9b4-f3f9b6799658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:52.978145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9e892-c00f-4c2d-b9b4-f3f9b6799658 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:52.999982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1051/2112] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:55:53.001782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9e892-c00f-4c2d-b9b4-f3f9b6799658 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:53.018256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9e892-c00f-4c2d-b9b4-f3f9b6799658 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:53.024973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc0aa4-cd79-4923-a2ea-8f1bf43cf38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:53.025885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0aa4-cd79-4923-a2ea-8f1bf43cf38e admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:53.026201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0aa4-cd79-4923-a2ea-8f1bf43cf38e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:53.026484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc0aa4-cd79-4923-a2ea-8f1bf43cf38e admin admin] PATH_INFO: `/v3/projects/6de28696164d4ab499eb89417aa330d3/users/355869e4e6374d58897d6ff8c205a28e/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:53.028812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc0aa4-cd79-4923-a2ea-8f1bf43cf38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de28696164d4ab499eb89417aa330d3, user_id=355869e4e6374d58897d6ff8c205a28e, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:53.032421 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc0aa4-cd79-4923-a2ea-8f1bf43cf38e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:53.063733 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1052/2113] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:55:53 2022] PUT /identity/v3/projects/6de28696164d4ab499eb89417aa330d3/users/355869e4e6374d58897d6ff8c205a28e/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:53.065674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1e511-0cf9-478f-bab1-7d36b0fd1337 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:53.065991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1e511-0cf9-478f-bab1-7d36b0fd1337 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:53.066279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1e511-0cf9-478f-bab1-7d36b0fd1337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:53.107278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8be1e511-0cf9-478f-bab1-7d36b0fd1337 None None] MFA Rules not processed for user `355869e4e6374d58897d6ff8c205a28e`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:53.108557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8be1e511-0cf9-478f-bab1-7d36b0fd1337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:53.123720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1062/2114] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:53.259523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1053/2115] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:53.305305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736a33-09ad-4437-a241-626d1d20cbd5 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:53.306873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-31736a33-09ad-4437-a241-626d1d20cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:53.490591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736a33-09ad-4437-a241-626d1d20cbd5 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:53.650206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b058f68-7511-4496-b36e-f2e2f2c8ed93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:53.652394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b058f68-7511-4496-b36e-f2e2f2c8ed93 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:53.653409 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b058f68-7511-4496-b36e-f2e2f2c8ed93 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:53.654304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b058f68-7511-4496-b36e-f2e2f2c8ed93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:53.674092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b058f68-7511-4496-b36e-f2e2f2c8ed93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:53.677502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b058f68-7511-4496-b36e-f2e2f2c8ed93 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:53.700856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1063/2116] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:53.833899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1e511-0cf9-478f-bab1-7d36b0fd1337 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:53.836160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8be1e511-0cf9-478f-bab1-7d36b0fd1337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:53.864017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1e511-0cf9-478f-bab1-7d36b0fd1337 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:53.878836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ca661-ba92-42ee-9ae8-5fb101aef604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:53.879534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ca661-ba92-42ee-9ae8-5fb101aef604 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:53.879810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ca661-ba92-42ee-9ae8-5fb101aef604 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:53.883436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ca661-ba92-42ee-9ae8-5fb101aef604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:54.028789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ca661-ba92-42ee-9ae8-5fb101aef604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:54.030283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ca661-ba92-42ee-9ae8-5fb101aef604 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:54.044201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1054/2117] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:55:58.908203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b058f68-7511-4496-b36e-f2e2f2c8ed93 service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:59.042813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b058f68-7511-4496-b36e-f2e2f2c8ed93 service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:59.055033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:59.056245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:59.056627 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:59.057551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] PATH_INFO: `/v3/users/f7a2c8b02f8a4b4fb4f687701b795889` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:59.059384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a2c8b02f8a4b4fb4f687701b795889)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:59.062229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:59.145889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a2c8b02f8a4b4fb4f687701b795889'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:59.219397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a2c8b02f8a4b4fb4f687701b795889'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:59.239244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a2c8b02f8a4b4fb4f687701b795889'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:59.240015 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a2c8b02f8a4b4fb4f687701b795889'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:59.251463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a2c8b02f8a4b4fb4f687701b795889'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:55:59.261814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1064/2118] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:55:58 2022] DELETE /identity/v3/users/f7a2c8b02f8a4b4fb4f687701b795889 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:55:59.266418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3416-a7eb-4560-820d-917d96d11881 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:59.267120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3416-a7eb-4560-820d-917d96d11881 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:59.267120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3416-a7eb-4560-820d-917d96d11881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:59.301642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-296d3416-a7eb-4560-820d-917d96d11881 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:55:59.306765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-296d3416-a7eb-4560-820d-917d96d11881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:59.555129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1055/2119] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:55:59.593269 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:55:59.595346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:55:59.751374 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925212e1-3d61-4377-974b-bf1a2734204c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:55:59.776032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed66ef2-bc40-4c03-80d0-c37bf2f1935a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:55:59.777067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed66ef2-bc40-4c03-80d0-c37bf2f1935a service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:55:59.777553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed66ef2-bc40-4c03-80d0-c37bf2f1935a service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:55:59.778073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed66ef2-bc40-4c03-80d0-c37bf2f1935a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:55:59.815177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed66ef2-bc40-4c03-80d0-c37bf2f1935a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:55:59.821008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed66ef2-bc40-4c03-80d0-c37bf2f1935a service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:55:59.852935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1065/2120] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:00.515059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d3416-a7eb-4560-820d-917d96d11881 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:00.517297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-296d3416-a7eb-4560-820d-917d96d11881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:00.543766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d3416-a7eb-4560-820d-917d96d11881 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:00.560312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:00.562707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:00.563589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:00.564285 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] PATH_INFO: `/v3/projects/da1537720b374439a97bd7b50b1ad49d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:00.567788 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1537720b374439a97bd7b50b1ad49d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:00.573170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:00.724615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1537720b374439a97bd7b50b1ad49d', 'request_id': 'req-b7a9889b-2814-4f03-818b-744548c38a24'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:00.741138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1537720b374439a97bd7b50b1ad49d', 'request_id': 'req-b7a9889b-2814-4f03-818b-744548c38a24'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:00.757807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1537720b374439a97bd7b50b1ad49d', 'request_id': 'req-b7a9889b-2814-4f03-818b-744548c38a24'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:00.792662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] The token cache is being invalidate because project da1537720b374439a97bd7b50b1ad49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:00.792969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:00.795682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b7a9889b-2814-4f03-818b-744548c38a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:00.798030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1056/2121] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:00 2022] DELETE /identity/v3/projects/da1537720b374439a97bd7b50b1ad49d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:00.804019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed66ef2-bc40-4c03-80d0-c37bf2f1935a service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:00.815711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed66ef2-bc40-4c03-80d0-c37bf2f1935a service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:00.956547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:00.957574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:00.958086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:00.958581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] PATH_INFO: `/v3/users/355869e4e6374d58897d6ff8c205a28e` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:00.960378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=355869e4e6374d58897d6ff8c205a28e)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:00.966652 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:01.090824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '355869e4e6374d58897d6ff8c205a28e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:01.137659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '355869e4e6374d58897d6ff8c205a28e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:01.155745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '355869e4e6374d58897d6ff8c205a28e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:01.156979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '355869e4e6374d58897d6ff8c205a28e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:01.172480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '355869e4e6374d58897d6ff8c205a28e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:01.180358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1066/2122] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:00 2022] DELETE /identity/v3/users/355869e4e6374d58897d6ff8c205a28e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:01.863385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e73802-80db-458f-8599-3102fa85026a None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:01.864535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e73802-80db-458f-8599-3102fa85026a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:01.865767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e73802-80db-458f-8599-3102fa85026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:01.917643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-97e73802-80db-458f-8599-3102fa85026a None None] MFA Rules not processed for user `d34d73f6eda24d9ca604ab9c14ab0509`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:01.919692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-97e73802-80db-458f-8599-3102fa85026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:02.087245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1057/2123] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:02.105487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:02.107693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:02.240375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e73802-80db-458f-8599-3102fa85026a None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:02.244737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-97e73802-80db-458f-8599-3102fa85026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:02.330896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa65bad-e70b-4105-a1a7-b95a1105b501 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:02.338941 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d3e20-6ff6-4fc8-9b5b-897d557d4ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:02.340329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d3e20-6ff6-4fc8-9b5b-897d557d4ed5 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:02.340943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d3e20-6ff6-4fc8-9b5b-897d557d4ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:02.344938 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d3e20-6ff6-4fc8-9b5b-897d557d4ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:02.360401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-775d3e20-6ff6-4fc8-9b5b-897d557d4ed5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:02.523924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d3e20-6ff6-4fc8-9b5b-897d557d4ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:02.528826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d3e20-6ff6-4fc8-9b5b-897d557d4ed5 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:02.546657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e73802-80db-458f-8599-3102fa85026a None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:02.572615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:02.574519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:02.586533 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:02.586663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] PATH_INFO: `/v3/projects/6de28696164d4ab499eb89417aa330d3` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:02.588751 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de28696164d4ab499eb89417aa330d3)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:02.592475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:02.597425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1067/2124] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:02.744303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de28696164d4ab499eb89417aa330d3', 'request_id': 'req-ca1c14de-5342-41d7-b7e8-414c1ca7b573'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:02.790210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de28696164d4ab499eb89417aa330d3', 'request_id': 'req-ca1c14de-5342-41d7-b7e8-414c1ca7b573'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:02.819421 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de28696164d4ab499eb89417aa330d3', 'request_id': 'req-ca1c14de-5342-41d7-b7e8-414c1ca7b573'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:02.871005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] The token cache is being invalidate because project 6de28696164d4ab499eb89417aa330d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:02.872786 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:02.875093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca1c14de-5342-41d7-b7e8-414c1ca7b573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:02.878875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1058/2125] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:02 2022] DELETE /identity/v3/projects/6de28696164d4ab499eb89417aa330d3 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:02.892502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7ff1-e082-49d3-ba17-a48b1fe956ee None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:02.893252 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7ff1-e082-49d3-ba17-a48b1fe956ee None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:02.894118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7ff1-e082-49d3-ba17-a48b1fe956ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:02.990402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-34de7ff1-e082-49d3-ba17-a48b1fe956ee None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:02.993733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-34de7ff1-e082-49d3-ba17-a48b1fe956ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:03.200487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1068/2126] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:03.212374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5de418-4341-4fce-8443-7a80394ce6e5 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:03.212681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5de418-4341-4fce-8443-7a80394ce6e5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:03.213627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5de418-4341-4fce-8443-7a80394ce6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:03.287394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1f5de418-4341-4fce-8443-7a80394ce6e5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:03.294350 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1f5de418-4341-4fce-8443-7a80394ce6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:03.332344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1059/2127] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:03.341219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7ff1-e082-49d3-ba17-a48b1fe956ee None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:03.384441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7ff1-e082-49d3-ba17-a48b1fe956ee None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:03.404598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3247-1957-4b43-a332-b4e4b16446e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:03.406733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3247-1957-4b43-a332-b4e4b16446e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:03.407885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3247-1957-4b43-a332-b4e4b16446e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:03.408941 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3247-1957-4b43-a332-b4e4b16446e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:03.413264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a3247-1957-4b43-a332-b4e4b16446e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:03.413760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a3247-1957-4b43-a332-b4e4b16446e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:03.417172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a3247-1957-4b43-a332-b4e4b16446e2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:03.468852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1069/2128] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:03.478063 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5de418-4341-4fce-8443-7a80394ce6e5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:03.508579 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5de418-4341-4fce-8443-7a80394ce6e5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:03.551274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2660-f8c2-4824-b5f6-4fd8de08bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:03.553875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2660-f8c2-4824-b5f6-4fd8de08bd54 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:03.555456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2660-f8c2-4824-b5f6-4fd8de08bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:03.556073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2660-f8c2-4824-b5f6-4fd8de08bd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:03.567196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d2660-f8c2-4824-b5f6-4fd8de08bd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:03.575317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d2660-f8c2-4824-b5f6-4fd8de08bd54 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:03.651254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1060/2129] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:03 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:03.655835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3247-1957-4b43-a332-b4e4b16446e2 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:03.670815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3247-1957-4b43-a332-b4e4b16446e2 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:03.846881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db9b4e-a361-48d4-9815-30b7b2ca972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:03.848092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db9b4e-a361-48d4-9815-30b7b2ca972a admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:03.851486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db9b4e-a361-48d4-9815-30b7b2ca972a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:03.852134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db9b4e-a361-48d4-9815-30b7b2ca972a admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:03.853134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db9b4e-a361-48d4-9815-30b7b2ca972a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:03.855653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db9b4e-a361-48d4-9815-30b7b2ca972a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:03.926391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2660-f8c2-4824-b5f6-4fd8de08bd54 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:03.937036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1070/2130] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:03 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:03.940926 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2660-f8c2-4824-b5f6-4fd8de08bd54 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:03.947953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437ae8-c484-4ca9-ad19-62ae506129fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:03.948664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437ae8-c484-4ca9-ad19-62ae506129fe admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:03.950256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437ae8-c484-4ca9-ad19-62ae506129fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:03.950578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437ae8-c484-4ca9-ad19-62ae506129fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:03.951617 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99437ae8-c484-4ca9-ad19-62ae506129fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:03.953309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99437ae8-c484-4ca9-ad19-62ae506129fe admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:03.969901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1061/2131] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:03.975646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db9b4e-a361-48d4-9815-30b7b2ca972a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:03.996729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db9b4e-a361-48d4-9815-30b7b2ca972a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:04.007368 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddfb36-0480-40ac-b64d-3f178fae6bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:04.008998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfb36-0480-40ac-b64d-3f178fae6bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:04.009564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfb36-0480-40ac-b64d-3f178fae6bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:04.009999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfb36-0480-40ac-b64d-3f178fae6bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:04.012679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddfb36-0480-40ac-b64d-3f178fae6bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:04.021661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddfb36-0480-40ac-b64d-3f178fae6bc6 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:04.078897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1071/2132] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:04.085774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437ae8-c484-4ca9-ad19-62ae506129fe admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:04.109309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437ae8-c484-4ca9-ad19-62ae506129fe admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:04.123896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de6167-a8b7-47f1-bb17-a519418f7873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:04.125917 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de6167-a8b7-47f1-bb17-a519418f7873 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:04.127862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de6167-a8b7-47f1-bb17-a519418f7873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:04.128368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de6167-a8b7-47f1-bb17-a519418f7873 admin admin] PATH_INFO: `/v3/projects/0588af0152c84df28010ba8a1c84fbb1/users/8ae59d4dede241d8afacdf8928d1c07f/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:04.210184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de6167-a8b7-47f1-bb17-a519418f7873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0588af0152c84df28010ba8a1c84fbb1, user_id=8ae59d4dede241d8afacdf8928d1c07f, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:04.213545 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de6167-a8b7-47f1-bb17-a519418f7873 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:04.233929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1062/2133] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:04 2022] PUT /identity/v3/projects/0588af0152c84df28010ba8a1c84fbb1/users/8ae59d4dede241d8afacdf8928d1c07f/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:04.246476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d444de3-2de9-4938-8e91-6a093540c80d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:04.247357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d444de3-2de9-4938-8e91-6a093540c80d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:04.248245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d444de3-2de9-4938-8e91-6a093540c80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:04.313468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7d444de3-2de9-4938-8e91-6a093540c80d None None] MFA Rules not processed for user `8ae59d4dede241d8afacdf8928d1c07f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:04.317077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7d444de3-2de9-4938-8e91-6a093540c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:04.481600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1072/2134] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:04.487985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de6167-a8b7-47f1-bb17-a519418f7873 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:04.670622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de6167-a8b7-47f1-bb17-a519418f7873 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:04.693337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9117-08cd-4501-91de-39d2b4ae44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:04.694625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9117-08cd-4501-91de-39d2b4ae44a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:04.695114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9117-08cd-4501-91de-39d2b4ae44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:04.695576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9117-08cd-4501-91de-39d2b4ae44a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:04.697647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed9117-08cd-4501-91de-39d2b4ae44a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:04.701875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed9117-08cd-4501-91de-39d2b4ae44a2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:04.784467 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1063/2135] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:04 2022] POST /identity/v3/projects => generated 377 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:04.789072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d444de3-2de9-4938-8e91-6a093540c80d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:04.807179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d444de3-2de9-4938-8e91-6a093540c80d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:04.965290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885aeca-fd40-411d-8c59-d8bf1227cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:04.967502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885aeca-fd40-411d-8c59-d8bf1227cdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:04.968000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885aeca-fd40-411d-8c59-d8bf1227cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:04.968462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885aeca-fd40-411d-8c59-d8bf1227cdc0 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:04.970331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885aeca-fd40-411d-8c59-d8bf1227cdc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:04.974918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885aeca-fd40-411d-8c59-d8bf1227cdc0 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:05.017299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1073/2136] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:04 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:05.021801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9117-08cd-4501-91de-39d2b4ae44a2 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:05.035263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9117-08cd-4501-91de-39d2b4ae44a2 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:05.041002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184413f-9a3b-49bb-93b1-07a1571b6f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:05.041806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184413f-9a3b-49bb-93b1-07a1571b6f5b admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:05.042221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184413f-9a3b-49bb-93b1-07a1571b6f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:05.042756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184413f-9a3b-49bb-93b1-07a1571b6f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:05.043583 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184413f-9a3b-49bb-93b1-07a1571b6f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:05.045305 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184413f-9a3b-49bb-93b1-07a1571b6f5b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:05.060486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1064/2137] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:05.065505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885aeca-fd40-411d-8c59-d8bf1227cdc0 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:05.082373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885aeca-fd40-411d-8c59-d8bf1227cdc0 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:05.089086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501bdfe-a5eb-47b5-8c6e-bb2aa5ce535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:05.090362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501bdfe-a5eb-47b5-8c6e-bb2aa5ce535b admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:05.090709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501bdfe-a5eb-47b5-8c6e-bb2aa5ce535b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:05.091830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501bdfe-a5eb-47b5-8c6e-bb2aa5ce535b admin admin] PATH_INFO: `/v3/projects/2bc5617885a24b1cb6a23fca2dd8d2af/users/a57b93e43036443fa1d7bbf623669a4d/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:05.116677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501bdfe-a5eb-47b5-8c6e-bb2aa5ce535b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc5617885a24b1cb6a23fca2dd8d2af, user_id=a57b93e43036443fa1d7bbf623669a4d, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:05.120182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501bdfe-a5eb-47b5-8c6e-bb2aa5ce535b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:05.146058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1074/2138] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:05 2022] PUT /identity/v3/projects/2bc5617885a24b1cb6a23fca2dd8d2af/users/a57b93e43036443fa1d7bbf623669a4d/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:05.157407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184413f-9a3b-49bb-93b1-07a1571b6f5b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:05.172230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184413f-9a3b-49bb-93b1-07a1571b6f5b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:05.262527 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a54c82-5ee2-4ec4-b05c-ee3ab54c71e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:05.264144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a54c82-5ee2-4ec4-b05c-ee3ab54c71e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:05.264867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a54c82-5ee2-4ec4-b05c-ee3ab54c71e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:05.265828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a54c82-5ee2-4ec4-b05c-ee3ab54c71e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:05.267838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a54c82-5ee2-4ec4-b05c-ee3ab54c71e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:05.272223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a54c82-5ee2-4ec4-b05c-ee3ab54c71e5 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:05.300739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1065/2139] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:05.302385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501bdfe-a5eb-47b5-8c6e-bb2aa5ce535b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:05.320673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501bdfe-a5eb-47b5-8c6e-bb2aa5ce535b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:05.334563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946695cf-ff13-4c7b-be28-dd007119c77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:05.335174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946695cf-ff13-4c7b-be28-dd007119c77e admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:05.335516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946695cf-ff13-4c7b-be28-dd007119c77e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:05.335906 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946695cf-ff13-4c7b-be28-dd007119c77e admin admin] PATH_INFO: `/v3/projects/2bc5617885a24b1cb6a23fca2dd8d2af/users/a57b93e43036443fa1d7bbf623669a4d/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:05.341700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946695cf-ff13-4c7b-be28-dd007119c77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc5617885a24b1cb6a23fca2dd8d2af, user_id=a57b93e43036443fa1d7bbf623669a4d, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:05.349081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946695cf-ff13-4c7b-be28-dd007119c77e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:05.378315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1075/2140] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:05 2022] PUT /identity/v3/projects/2bc5617885a24b1cb6a23fca2dd8d2af/users/a57b93e43036443fa1d7bbf623669a4d/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:05.389353 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b24845-e288-48b9-a488-86e35f28f76b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:05.389921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b24845-e288-48b9-a488-86e35f28f76b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:05.390314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b24845-e288-48b9-a488-86e35f28f76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:05.471489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-a9b24845-e288-48b9-a488-86e35f28f76b None None] MFA Rules not processed for user `a57b93e43036443fa1d7bbf623669a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:05.474593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a9b24845-e288-48b9-a488-86e35f28f76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:05.546108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6227d-a3d8-4ef1-9a0d-97cf7485246e None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:05.546631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6227d-a3d8-4ef1-9a0d-97cf7485246e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:05.547046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6227d-a3d8-4ef1-9a0d-97cf7485246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:05.580581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-28b6227d-a3d8-4ef1-9a0d-97cf7485246e None None] MFA Rules not processed for user `c460c594b2c845ff88dcbdc5c6ad1edc`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:05.582500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-28b6227d-a3d8-4ef1-9a0d-97cf7485246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:05.586327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1066/2141] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:05.600698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b24845-e288-48b9-a488-86e35f28f76b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:05.602670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a9b24845-e288-48b9-a488-86e35f28f76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:05.694121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1076/2142] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:05.730734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b24845-e288-48b9-a488-86e35f28f76b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:05.735435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c282-20da-4e7b-98ea-334d343605ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:05.736741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c282-20da-4e7b-98ea-334d343605ca service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:05.736741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c282-20da-4e7b-98ea-334d343605ca service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:05.736741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c282-20da-4e7b-98ea-334d343605ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:05.750335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415c282-20da-4e7b-98ea-334d343605ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:05.752056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415c282-20da-4e7b-98ea-334d343605ca service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:05.778208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1067/2143] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:05.867048 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6227d-a3d8-4ef1-9a0d-97cf7485246e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:05.868671 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-28b6227d-a3d8-4ef1-9a0d-97cf7485246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:06.009894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6227d-a3d8-4ef1-9a0d-97cf7485246e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:06.018016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:06.019423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:06.019849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:06.020354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] PATH_INFO: `/v3/users/56017826d84f45e5b966db806fd7d3e3` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:06.024345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56017826d84f45e5b966db806fd7d3e3)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:06.028577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:06.140321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56017826d84f45e5b966db806fd7d3e3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:06.174522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56017826d84f45e5b966db806fd7d3e3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:06.193974 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56017826d84f45e5b966db806fd7d3e3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:06.195916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56017826d84f45e5b966db806fd7d3e3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:06.213508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56017826d84f45e5b966db806fd7d3e3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:06.227864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1077/2144] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:05 2022] DELETE /identity/v3/users/56017826d84f45e5b966db806fd7d3e3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:06.235271 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e146c-a32a-44a1-b3e3-f7167bb8f008 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:06.236257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e146c-a32a-44a1-b3e3-f7167bb8f008 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:06.236257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e146c-a32a-44a1-b3e3-f7167bb8f008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:06.270393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-821e146c-a32a-44a1-b3e3-f7167bb8f008 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:06.272768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-821e146c-a32a-44a1-b3e3-f7167bb8f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:06.430107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1068/2145] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:06.446308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:06.450947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:06.501024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e146c-a32a-44a1-b3e3-f7167bb8f008 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:06.503237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-821e146c-a32a-44a1-b3e3-f7167bb8f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:06.644531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e5e16-3b66-4eb0-8e2d-fcc12873f01b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:06.656116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fda81-21a0-4c58-9e43-aac383ea57da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:06.657484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fda81-21a0-4c58-9e43-aac383ea57da service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:06.657889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fda81-21a0-4c58-9e43-aac383ea57da service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:06.658407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fda81-21a0-4c58-9e43-aac383ea57da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:06.671758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e146c-a32a-44a1-b3e3-f7167bb8f008 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:06.678487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fda81-21a0-4c58-9e43-aac383ea57da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:06.683228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fda81-21a0-4c58-9e43-aac383ea57da service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:06.684405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a7926-a81a-4e63-8695-be91d28e92c2 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b93e43036443fa1d7bbf623669a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc5617885a24b1cb6a23fca2dd8d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:06.685109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a7926-a81a-4e63-8695-be91d28e92c2 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:06.685642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a7926-a81a-4e63-8695-be91d28e92c2 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:06.686050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a7926-a81a-4e63-8695-be91d28e92c2 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:06.686800 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a7926-a81a-4e63-8695-be91d28e92c2 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:06.687111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a7926-a81a-4e63-8695-be91d28e92c2 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:06.689519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a7926-a81a-4e63-8695-be91d28e92c2 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:06.727118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1069/2146] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:06.727360 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1078/2147] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:56:06.736847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a7926-a81a-4e63-8695-be91d28e92c2 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:06.758346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a7926-a81a-4e63-8695-be91d28e92c2 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:06.776784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9a198-37c3-4db4-b40a-94d0d74e8a9e tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b93e43036443fa1d7bbf623669a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc5617885a24b1cb6a23fca2dd8d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:06.776784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9a198-37c3-4db4-b40a-94d0d74e8a9e tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:06.776784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9a198-37c3-4db4-b40a-94d0d74e8a9e tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:06.777275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9a198-37c3-4db4-b40a-94d0d74e8a9e tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:06.777275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9a198-37c3-4db4-b40a-94d0d74e8a9e tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:06.781178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9a198-37c3-4db4-b40a-94d0d74e8a9e tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:06.821180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1070/2148] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:06 2022] POST /identity/v3/projects => generated 354 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:06.823080 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fda81-21a0-4c58-9e43-aac383ea57da service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:06.861183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fda81-21a0-4c58-9e43-aac383ea57da service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:07.006350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b93e43036443fa1d7bbf623669a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc5617885a24b1cb6a23fca2dd8d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:07.008004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:07.008004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:07.008386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:07.009123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:07.009482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:07.011600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:07.031324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1079/2149] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:07.074734 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9a198-37c3-4db4-b40a-94d0d74e8a9e tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:07.089092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9a198-37c3-4db4-b40a-94d0d74e8a9e tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:07.094519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57b93e43036443fa1d7bbf623669a4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bc5617885a24b1cb6a23fca2dd8d2af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:07.095522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:07.095874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:07.096225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] PATH_INFO: `/v3/projects/50e751d2c8e4492b973ed704b327e079` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:07.097864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Authorizing `identity:delete_project(project_id=50e751d2c8e4492b973ed704b327e079)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:07.100239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:07.166660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e751d2c8e4492b973ed704b327e079', 'request_id': 'req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.186445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e751d2c8e4492b973ed704b327e079', 'request_id': 'req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.201607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e751d2c8e4492b973ed704b327e079', 'request_id': 'req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.255364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] The token cache is being invalidate because project 50e751d2c8e4492b973ed704b327e079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:07.256161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.257414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.259823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1071/2150] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:07 2022] DELETE /identity/v3/projects/50e751d2c8e4492b973ed704b327e079 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:07.271229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:07.282276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:07.391895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ebe16-97a1-48d3-a164-bc0cb7ac7b08 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:07.520347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:07.520347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:07.520347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:07.520347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] PATH_INFO: `/v3/projects/c27a6342150a4a3ea74a2d30923c9c56` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:07.521336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27a6342150a4a3ea74a2d30923c9c56)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:07.521336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:07.617768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:07.619547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:07.640403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7bc8d-3cb0-4c0b-9f89-ab70a418aaf0 tempest-VolumeQuotaClassesTest-96568543 tempest-VolumeQuotaClassesTest-96568543-project-admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:07.654937 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27a6342150a4a3ea74a2d30923c9c56', 'request_id': 'req-110748d7-30a4-443d-b309-9d214057c88a'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.663904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27a6342150a4a3ea74a2d30923c9c56', 'request_id': 'req-110748d7-30a4-443d-b309-9d214057c88a'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.674539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27a6342150a4a3ea74a2d30923c9c56', 'request_id': 'req-110748d7-30a4-443d-b309-9d214057c88a'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.694294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] The token cache is being invalidate because project c27a6342150a4a3ea74a2d30923c9c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:07.694680 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.695449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.702262 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1080/2151] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:07 2022] DELETE /identity/v3/projects/c27a6342150a4a3ea74a2d30923c9c56 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:07.703899 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:07.706482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:07.782858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:07.786400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:07.787310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:07.787942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] PATH_INFO: `/v3/users/8ae59d4dede241d8afacdf8928d1c07f` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:07.789696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae59d4dede241d8afacdf8928d1c07f)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:07.792463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:07.858286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110748d7-30a4-443d-b309-9d214057c88a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:07.865163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:07.866296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:07.866888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:07.868193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] PATH_INFO: `/v3/users/3a426ed4a6bd40c895d54594505278f4` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:07.869422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a426ed4a6bd40c895d54594505278f4)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:07.871863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:07.920740 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae59d4dede241d8afacdf8928d1c07f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.921884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae59d4dede241d8afacdf8928d1c07f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.922920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae59d4dede241d8afacdf8928d1c07f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.940990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae59d4dede241d8afacdf8928d1c07f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:07.954322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ca22928d-9229-46fe-8792-07048392800e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae59d4dede241d8afacdf8928d1c07f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.005426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1072/2152] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:07 2022] DELETE /identity/v3/users/8ae59d4dede241d8afacdf8928d1c07f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:08.006656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a426ed4a6bd40c895d54594505278f4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.011212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c1ae8-aaa8-446e-983f-efa5f3d714af None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:08.011574 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c1ae8-aaa8-446e-983f-efa5f3d714af None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:08.011907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c1ae8-aaa8-446e-983f-efa5f3d714af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:08.026201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a426ed4a6bd40c895d54594505278f4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.041742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a426ed4a6bd40c895d54594505278f4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.043636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a426ed4a6bd40c895d54594505278f4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.052542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1e9c1ae8-aaa8-446e-983f-efa5f3d714af None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:08.054147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1e9c1ae8-aaa8-446e-983f-efa5f3d714af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:08.063994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a426ed4a6bd40c895d54594505278f4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.073407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1081/2153] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:07 2022] DELETE /identity/v3/users/3a426ed4a6bd40c895d54594505278f4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:08.146541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1073/2154] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:08.157291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:08.159536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:08.238671 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3d6d4-9df9-4c13-b1e3-b0fffd615001 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:08.242965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4d83e-4866-4ae0-bbd8-81800e8e990d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:08.243633 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d83e-4866-4ae0-bbd8-81800e8e990d service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:08.243916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d83e-4866-4ae0-bbd8-81800e8e990d service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:08.244228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d83e-4866-4ae0-bbd8-81800e8e990d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:08.362363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4d83e-4866-4ae0-bbd8-81800e8e990d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:08.364412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4d83e-4866-4ae0-bbd8-81800e8e990d service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:08.376727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1082/2155] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:08.625729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c1ae8-aaa8-446e-983f-efa5f3d714af None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:08.630894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1e9c1ae8-aaa8-446e-983f-efa5f3d714af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:08.659778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c1ae8-aaa8-446e-983f-efa5f3d714af None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:08.665490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:08.667020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:08.667469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:08.667900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] PATH_INFO: `/v3/projects/38b8223110c443c08af1c1c129968a7f` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:08.669846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b8223110c443c08af1c1c129968a7f)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:08.672265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:08.762257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b8223110c443c08af1c1c129968a7f', 'request_id': 'req-0276381f-7e0d-408a-b116-451306bf485d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.784926 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b8223110c443c08af1c1c129968a7f', 'request_id': 'req-0276381f-7e0d-408a-b116-451306bf485d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.788905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b8223110c443c08af1c1c129968a7f', 'request_id': 'req-0276381f-7e0d-408a-b116-451306bf485d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.807228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] The token cache is being invalidate because project 38b8223110c443c08af1c1c129968a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:08.807540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.808942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:08.811442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1074/2156] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:08 2022] DELETE /identity/v3/projects/38b8223110c443c08af1c1c129968a7f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:08.816510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7effb4-06e2-4c7b-9b29-90c0f5c41426 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:08.817110 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7effb4-06e2-4c7b-9b29-90c0f5c41426 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:08.817110 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7effb4-06e2-4c7b-9b29-90c0f5c41426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:08.837789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fc7effb4-06e2-4c7b-9b29-90c0f5c41426 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:08.839226 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fc7effb4-06e2-4c7b-9b29-90c0f5c41426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:08.851575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:08.852887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:08.944929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1083/2157] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:08.952604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d912-5d9d-45cd-89b5-b579ee98208e None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:08.953321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d912-5d9d-45cd-89b5-b579ee98208e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:08.953722 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d912-5d9d-45cd-89b5-b579ee98208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:08.973605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276381f-7e0d-408a-b116-451306bf485d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:08.974760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-10d1d912-5d9d-45cd-89b5-b579ee98208e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:08.976153 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-10d1d912-5d9d-45cd-89b5-b579ee98208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:08.980356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:08.981420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:08.981792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:08.982293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] PATH_INFO: `/v3/projects/0588af0152c84df28010ba8a1c84fbb1` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:08.983903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0588af0152c84df28010ba8a1c84fbb1)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:08.985977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1084/2158] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:08.986273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:08.989310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1d912-5d9d-45cd-89b5-b579ee98208e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.000295 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1d912-5d9d-45cd-89b5-b579ee98208e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.005600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0b4d5-3add-4e91-ba5e-f294197df0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:09.006448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0b4d5-3add-4e91-ba5e-f294197df0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.007375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0b4d5-3add-4e91-ba5e-f294197df0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.007740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0b4d5-3add-4e91-ba5e-f294197df0b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.008800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0b4d5-3add-4e91-ba5e-f294197df0b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:09.009168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0b4d5-3add-4e91-ba5e-f294197df0b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:09.011106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0b4d5-3add-4e91-ba5e-f294197df0b8 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:09.032122 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1085/2159] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:09.034582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0b4d5-3add-4e91-ba5e-f294197df0b8 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.050738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0b4d5-3add-4e91-ba5e-f294197df0b8 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.057698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f4281-7de1-4a5e-a4c7-add736eed89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:09.058815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f4281-7de1-4a5e-a4c7-add736eed89e admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.059266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f4281-7de1-4a5e-a4c7-add736eed89e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.060771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f4281-7de1-4a5e-a4c7-add736eed89e admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.062162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f4281-7de1-4a5e-a4c7-add736eed89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:09.065826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f4281-7de1-4a5e-a4c7-add736eed89e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:09.071515 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0588af0152c84df28010ba8a1c84fbb1', 'request_id': 'req-c216d7dc-a831-478a-8060-802c3ceb0b08'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.079447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0588af0152c84df28010ba8a1c84fbb1', 'request_id': 'req-c216d7dc-a831-478a-8060-802c3ceb0b08'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.089064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0588af0152c84df28010ba8a1c84fbb1', 'request_id': 'req-c216d7dc-a831-478a-8060-802c3ceb0b08'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.119561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] The token cache is being invalidate because project 0588af0152c84df28010ba8a1c84fbb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:09.120169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.121241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.123731 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1075/2160] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:08 2022] DELETE /identity/v3/projects/0588af0152c84df28010ba8a1c84fbb1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:09.133433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1086/2161] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:09 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:09.133929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.133929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:09.134677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f4281-7de1-4a5e-a4c7-add736eed89e admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.136478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-748f4281-7de1-4a5e-a4c7-add736eed89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:09.228190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216d7dc-a831-478a-8060-802c3ceb0b08 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.232928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f4281-7de1-4a5e-a4c7-add736eed89e admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.233199 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:09.234179 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.234466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.234749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] PATH_INFO: `/v3/users/a57b93e43036443fa1d7bbf623669a4d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.236048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57b93e43036443fa1d7bbf623669a4d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:09.238351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:09.239146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db4a9-4f28-4907-ac3f-cf2362465e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:09.240021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db4a9-4f28-4907-ac3f-cf2362465e3f admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.240313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db4a9-4f28-4907-ac3f-cf2362465e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.240583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db4a9-4f28-4907-ac3f-cf2362465e3f admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.241365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db4a9-4f28-4907-ac3f-cf2362465e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:09.243714 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db4a9-4f28-4907-ac3f-cf2362465e3f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:09.277747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1087/2162] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:09 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:56:09.279838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db4a9-4f28-4907-ac3f-cf2362465e3f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.292985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db4a9-4f28-4907-ac3f-cf2362465e3f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.298308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a42f9-a15b-43ed-98f3-afff2f77ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:09.299142 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a42f9-a15b-43ed-98f3-afff2f77ddce admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.299432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a42f9-a15b-43ed-98f3-afff2f77ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.299708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a42f9-a15b-43ed-98f3-afff2f77ddce admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.300437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a42f9-a15b-43ed-98f3-afff2f77ddce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:09.302317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57b93e43036443fa1d7bbf623669a4d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.302648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a42f9-a15b-43ed-98f3-afff2f77ddce admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:09.302949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57b93e43036443fa1d7bbf623669a4d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.303563 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57b93e43036443fa1d7bbf623669a4d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.316711 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57b93e43036443fa1d7bbf623669a4d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.318218 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1088/2163] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:09.322848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a42f9-a15b-43ed-98f3-afff2f77ddce admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.327829 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-669a42f9-a15b-43ed-98f3-afff2f77ddce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:09.340690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57b93e43036443fa1d7bbf623669a4d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:09.342616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a42f9-a15b-43ed-98f3-afff2f77ddce admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.350009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecc69e-416d-409e-b25d-8295b889a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:09.351507 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc69e-416d-409e-b25d-8295b889a024 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.351641 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc69e-416d-409e-b25d-8295b889a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.351994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc69e-416d-409e-b25d-8295b889a024 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.353296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecc69e-416d-409e-b25d-8295b889a024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:09.355796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecc69e-416d-409e-b25d-8295b889a024 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:09.360482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1076/2164] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:09 2022] DELETE /identity/v3/users/a57b93e43036443fa1d7bbf623669a4d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:09.376790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1089/2165] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:09.382898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.508782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9d477-8f78-42ad-b066-9a2a8a82f4d2 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.522623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94430-9254-4178-a5e1-c3339eec9d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:09.524192 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94430-9254-4178-a5e1-c3339eec9d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.524757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94430-9254-4178-a5e1-c3339eec9d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.525273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94430-9254-4178-a5e1-c3339eec9d53 admin admin] PATH_INFO: `/v3/projects/112c04631d444bbb90e120df64ea6572/users/3c1386254a334408974e398e9ecb711f/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.545930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca94430-9254-4178-a5e1-c3339eec9d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112c04631d444bbb90e120df64ea6572, user_id=3c1386254a334408974e398e9ecb711f, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:09.550026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca94430-9254-4178-a5e1-c3339eec9d53 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:09.576642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1077/2166] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:09 2022] PUT /identity/v3/projects/112c04631d444bbb90e120df64ea6572/users/3c1386254a334408974e398e9ecb711f/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:09.588748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686f1bf-c75d-4a6b-83ba-d0f5cd87789a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.589079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686f1bf-c75d-4a6b-83ba-d0f5cd87789a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.589332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686f1bf-c75d-4a6b-83ba-d0f5cd87789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.642920 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6686f1bf-c75d-4a6b-83ba-d0f5cd87789a None None] MFA Rules not processed for user `3c1386254a334408974e398e9ecb711f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:09.644883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6686f1bf-c75d-4a6b-83ba-d0f5cd87789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:09.749192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1090/2167] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:09.751657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94430-9254-4178-a5e1-c3339eec9d53 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.863257 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94430-9254-4178-a5e1-c3339eec9d53 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.869708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c6622-1252-4c0d-ab4f-04fa7f695dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:09.870435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c6622-1252-4c0d-ab4f-04fa7f695dcd admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.870758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c6622-1252-4c0d-ab4f-04fa7f695dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.871026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c6622-1252-4c0d-ab4f-04fa7f695dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.871806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c6622-1252-4c0d-ab4f-04fa7f695dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:09.873789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c6622-1252-4c0d-ab4f-04fa7f695dcd admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:09.906900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1078/2168] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:09 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:09.910181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686f1bf-c75d-4a6b-83ba-d0f5cd87789a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.910872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c6622-1252-4c0d-ab4f-04fa7f695dcd admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:09.912421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6686f1bf-c75d-4a6b-83ba-d0f5cd87789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:09.938819 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686f1bf-c75d-4a6b-83ba-d0f5cd87789a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.988984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c6622-1252-4c0d-ab4f-04fa7f695dcd admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:09.994220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1900d-d5bc-484e-8ad1-b88f1f325a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:09.994911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1900d-d5bc-484e-8ad1-b88f1f325a0d admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:09.995239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1900d-d5bc-484e-8ad1-b88f1f325a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:09.995469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1900d-d5bc-484e-8ad1-b88f1f325a0d admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:09.996238 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1900d-d5bc-484e-8ad1-b88f1f325a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:09.998472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1900d-d5bc-484e-8ad1-b88f1f325a0d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.001890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.002802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.003080 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.003355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] PATH_INFO: `/v3/projects/2bc5617885a24b1cb6a23fca2dd8d2af` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.006159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc5617885a24b1cb6a23fca2dd8d2af)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.006524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.025460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1079/2169] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:09 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:10.026407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1900d-d5bc-484e-8ad1-b88f1f325a0d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.035782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1900d-d5bc-484e-8ad1-b88f1f325a0d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.040754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab9c8f-1559-40f6-a864-7dcd76209e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.041496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab9c8f-1559-40f6-a864-7dcd76209e58 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.041811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab9c8f-1559-40f6-a864-7dcd76209e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.042125 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab9c8f-1559-40f6-a864-7dcd76209e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.042855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab9c8f-1559-40f6-a864-7dcd76209e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.044428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab9c8f-1559-40f6-a864-7dcd76209e58 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.055107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1080/2170] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:10.057659 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc5617885a24b1cb6a23fca2dd8d2af', 'request_id': 'req-9cafcd7d-9da3-467f-a914-10b6f16a94d1'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:10.059534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab9c8f-1559-40f6-a864-7dcd76209e58 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.065261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc5617885a24b1cb6a23fca2dd8d2af', 'request_id': 'req-9cafcd7d-9da3-467f-a914-10b6f16a94d1'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:10.069906 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab9c8f-1559-40f6-a864-7dcd76209e58 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.072914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc5617885a24b1cb6a23fca2dd8d2af', 'request_id': 'req-9cafcd7d-9da3-467f-a914-10b6f16a94d1'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:10.084285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] The token cache is being invalidate because project 2bc5617885a24b1cb6a23fca2dd8d2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:10.084479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:10.085198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9cafcd7d-9da3-467f-a914-10b6f16a94d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:10.087495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1091/2171] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:09 2022] DELETE /identity/v3/projects/2bc5617885a24b1cb6a23fca2dd8d2af => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:10.092676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200d89-f76f-4e55-b607-3ae263d71e63 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.093012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200d89-f76f-4e55-b607-3ae263d71e63 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.093233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200d89-f76f-4e55-b607-3ae263d71e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.121794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-56200d89-f76f-4e55-b607-3ae263d71e63 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:10.123106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-56200d89-f76f-4e55-b607-3ae263d71e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:10.146548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2161a-67ca-415b-8156-ca62717ed4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.147532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2161a-67ca-415b-8156-ca62717ed4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.147897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2161a-67ca-415b-8156-ca62717ed4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.148060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2161a-67ca-415b-8156-ca62717ed4d0 admin admin] PATH_INFO: `/v3/projects/d531779f5d394af7b1469c2ae555e0d3/users/e06e206f940c4c0a9ce8992b2bf3d4cc/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.166332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2161a-67ca-415b-8156-ca62717ed4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d531779f5d394af7b1469c2ae555e0d3, user_id=e06e206f940c4c0a9ce8992b2bf3d4cc, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.169645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2161a-67ca-415b-8156-ca62717ed4d0 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.188668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1081/2172] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:10 2022] PUT /identity/v3/projects/d531779f5d394af7b1469c2ae555e0d3/users/e06e206f940c4c0a9ce8992b2bf3d4cc/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:10.189684 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2161a-67ca-415b-8156-ca62717ed4d0 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.191498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9bb2161a-67ca-415b-8156-ca62717ed4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:10.211029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1092/2173] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:10.213017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7c927-9371-44ab-8000-ab40cf0334f3 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.213314 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7c927-9371-44ab-8000-ab40cf0334f3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.213584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7c927-9371-44ab-8000-ab40cf0334f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.241081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-39e7c927-9371-44ab-8000-ab40cf0334f3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:10.242834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-39e7c927-9371-44ab-8000-ab40cf0334f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:10.273761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2161a-67ca-415b-8156-ca62717ed4d0 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.280488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a93a3f-e637-4820-9152-7d44349207ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.281352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a93a3f-e637-4820-9152-7d44349207ab admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.281739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a93a3f-e637-4820-9152-7d44349207ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.282152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a93a3f-e637-4820-9152-7d44349207ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.283019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a93a3f-e637-4820-9152-7d44349207ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.285318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a93a3f-e637-4820-9152-7d44349207ab admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.297274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1082/2174] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:10.301330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a93a3f-e637-4820-9152-7d44349207ab admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.311239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1093/2175] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:10.315887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7c927-9371-44ab-8000-ab40cf0334f3 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.316932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a93a3f-e637-4820-9152-7d44349207ab admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.322424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b55e2-dade-4d1f-815a-54db8c730f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.323488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b55e2-dade-4d1f-815a-54db8c730f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.323773 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b55e2-dade-4d1f-815a-54db8c730f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.324108 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b55e2-dade-4d1f-815a-54db8c730f0f admin admin] PATH_INFO: `/v3/projects/d531779f5d394af7b1469c2ae555e0d3/users/e06e206f940c4c0a9ce8992b2bf3d4cc/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.325497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7c927-9371-44ab-8000-ab40cf0334f3 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.328306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b55e2-dade-4d1f-815a-54db8c730f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d531779f5d394af7b1469c2ae555e0d3, user_id=e06e206f940c4c0a9ce8992b2bf3d4cc, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.330808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d863f5-6e4f-474f-a8e5-d0d7a4057652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.331012 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b55e2-dade-4d1f-815a-54db8c730f0f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.331475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d863f5-6e4f-474f-a8e5-d0d7a4057652 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.331778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d863f5-6e4f-474f-a8e5-d0d7a4057652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.332056 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d863f5-6e4f-474f-a8e5-d0d7a4057652 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.332780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d863f5-6e4f-474f-a8e5-d0d7a4057652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:10.333107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d863f5-6e4f-474f-a8e5-d0d7a4057652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.335319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d863f5-6e4f-474f-a8e5-d0d7a4057652 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.347101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1083/2176] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:10 2022] PUT /identity/v3/projects/d531779f5d394af7b1469c2ae555e0d3/users/e06e206f940c4c0a9ce8992b2bf3d4cc/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:10.351469 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1094/2177] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:56:10.354872 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b55e2-dade-4d1f-815a-54db8c730f0f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.361467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ea05b-5484-4ed7-9c67-4e14d88d7edb None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.361753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ea05b-5484-4ed7-9c67-4e14d88d7edb None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.362067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ea05b-5484-4ed7-9c67-4e14d88d7edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.393206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-403ea05b-5484-4ed7-9c67-4e14d88d7edb None None] MFA Rules not processed for user `e06e206f940c4c0a9ce8992b2bf3d4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:10.394553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-403ea05b-5484-4ed7-9c67-4e14d88d7edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:10.453958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b55e2-dade-4d1f-815a-54db8c730f0f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.459170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c467c-853b-4fa5-9b77-8b84b7e8a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.459967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c467c-853b-4fa5-9b77-8b84b7e8a654 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.460323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c467c-853b-4fa5-9b77-8b84b7e8a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.460671 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c467c-853b-4fa5-9b77-8b84b7e8a654 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.461791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c467c-853b-4fa5-9b77-8b84b7e8a654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.463839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c467c-853b-4fa5-9b77-8b84b7e8a654 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.501675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1084/2178] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:10 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:10.503330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c467c-853b-4fa5-9b77-8b84b7e8a654 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.510445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1095/2179] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:10.522494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ea05b-5484-4ed7-9c67-4e14d88d7edb None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.524229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-403ea05b-5484-4ed7-9c67-4e14d88d7edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:10.593606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ea05b-5484-4ed7-9c67-4e14d88d7edb None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.602996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c467c-853b-4fa5-9b77-8b84b7e8a654 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.610133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780b36-618b-4ab3-82b6-3928ca593f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.611342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780b36-618b-4ab3-82b6-3928ca593f6e admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.611797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780b36-618b-4ab3-82b6-3928ca593f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.612311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780b36-618b-4ab3-82b6-3928ca593f6e admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.613566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780b36-618b-4ab3-82b6-3928ca593f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.617064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780b36-618b-4ab3-82b6-3928ca593f6e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.646318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1085/2180] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:10 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:10.647707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780b36-618b-4ab3-82b6-3928ca593f6e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.647842 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65777936-9b2f-400f-9b09-94ae851f63ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.648675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65777936-9b2f-400f-9b09-94ae851f63ae service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.648963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65777936-9b2f-400f-9b09-94ae851f63ae service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.649238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65777936-9b2f-400f-9b09-94ae851f63ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.659243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780b36-618b-4ab3-82b6-3928ca593f6e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.666380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6f316-c9b5-4528-aec7-5b4042a3b3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.666790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f316-c9b5-4528-aec7-5b4042a3b3de admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.667102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f316-c9b5-4528-aec7-5b4042a3b3de admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.667335 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f316-c9b5-4528-aec7-5b4042a3b3de admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.668078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6f316-c9b5-4528-aec7-5b4042a3b3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.669739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6f316-c9b5-4528-aec7-5b4042a3b3de admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.682594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1086/2181] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:10.686373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6f316-c9b5-4528-aec7-5b4042a3b3de admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.699027 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6f316-c9b5-4528-aec7-5b4042a3b3de admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.705131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b2b3d-b413-4ab1-b432-e2977d56c87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.705131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b2b3d-b413-4ab1-b432-e2977d56c87b admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.705131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b2b3d-b413-4ab1-b432-e2977d56c87b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.705131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b2b3d-b413-4ab1-b432-e2977d56c87b admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.705783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b2b3d-b413-4ab1-b432-e2977d56c87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.707489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b2b3d-b413-4ab1-b432-e2977d56c87b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.721334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1087/2182] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:10.725594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b2b3d-b413-4ab1-b432-e2977d56c87b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.729929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65777936-9b2f-400f-9b09-94ae851f63ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.731410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65777936-9b2f-400f-9b09-94ae851f63ae service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.736167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b2b3d-b413-4ab1-b432-e2977d56c87b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.748475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47ec0-9281-4ec5-ab33-34345e354eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.749044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1096/2183] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:56:10.749897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47ec0-9281-4ec5-ab33-34345e354eac admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.750157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47ec0-9281-4ec5-ab33-34345e354eac admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.750437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47ec0-9281-4ec5-ab33-34345e354eac admin admin] PATH_INFO: `/v3/projects/7ff9eb7715514b1bb6be7bf301d90b42/users/37746ea4146b445eb9ce484d10e26241/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.779403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b47ec0-9281-4ec5-ab33-34345e354eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff9eb7715514b1bb6be7bf301d90b42, user_id=37746ea4146b445eb9ce484d10e26241, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.782992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b47ec0-9281-4ec5-ab33-34345e354eac admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.802586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1088/2184] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:10 2022] PUT /identity/v3/projects/7ff9eb7715514b1bb6be7bf301d90b42/users/37746ea4146b445eb9ce484d10e26241/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:10.813638 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5e4cd-d682-4525-a05a-24a1ff57c806 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.813858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5e4cd-d682-4525-a05a-24a1ff57c806 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.814204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5e4cd-d682-4525-a05a-24a1ff57c806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.849121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47ec0-9281-4ec5-ab33-34345e354eac admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.868988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c2d5e4cd-d682-4525-a05a-24a1ff57c806 None None] MFA Rules not processed for user `37746ea4146b445eb9ce484d10e26241`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:10.871817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c2d5e4cd-d682-4525-a05a-24a1ff57c806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:10.946909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47ec0-9281-4ec5-ab33-34345e354eac admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:10.954129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:10.955163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:10.955980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:10.955980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] PATH_INFO: `/v3/users/3c1386254a334408974e398e9ecb711f` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:10.957158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1386254a334408974e398e9ecb711f)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:10.960171 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:10.980216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1097/2185] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:10.987055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5e4cd-d682-4525-a05a-24a1ff57c806 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:10.998937 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5e4cd-d682-4525-a05a-24a1ff57c806 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.004737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab21b0-ccbd-4a1c-8ba3-ea15e537e6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.005713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab21b0-ccbd-4a1c-8ba3-ea15e537e6bd admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.006034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab21b0-ccbd-4a1c-8ba3-ea15e537e6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.006311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab21b0-ccbd-4a1c-8ba3-ea15e537e6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.007090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab21b0-ccbd-4a1c-8ba3-ea15e537e6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.009495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab21b0-ccbd-4a1c-8ba3-ea15e537e6bd admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.018885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1386254a334408974e398e9ecb711f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:11.019547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1386254a334408974e398e9ecb711f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:11.021331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1386254a334408974e398e9ecb711f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:11.030932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1386254a334408974e398e9ecb711f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:11.040133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2b905058-a586-49a6-88f0-acf5e393efd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1386254a334408974e398e9ecb711f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:11.045668 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1098/2186] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:10 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:11.046686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab21b0-ccbd-4a1c-8ba3-ea15e537e6bd admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:11.048318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c0ab21b0-ccbd-4a1c-8ba3-ea15e537e6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:11.064991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1089/2187] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:10 2022] DELETE /identity/v3/users/3c1386254a334408974e398e9ecb711f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:11.072382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ae03a-98e1-4cb8-80aa-826d26a935cf None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.072952 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ae03a-98e1-4cb8-80aa-826d26a935cf None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.073253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ae03a-98e1-4cb8-80aa-826d26a935cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.094909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-451ae03a-98e1-4cb8-80aa-826d26a935cf None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:11.096376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-451ae03a-98e1-4cb8-80aa-826d26a935cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:11.133835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab21b0-ccbd-4a1c-8ba3-ea15e537e6bd admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.157750 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1090/2188] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:11.168562 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ae03a-98e1-4cb8-80aa-826d26a935cf None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:11.170146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-451ae03a-98e1-4cb8-80aa-826d26a935cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:11.199218 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e85871-6918-4fdc-bddf-c7e4b7db0d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.199925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e85871-6918-4fdc-bddf-c7e4b7db0d01 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.200272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e85871-6918-4fdc-bddf-c7e4b7db0d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.200579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e85871-6918-4fdc-bddf-c7e4b7db0d01 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.201315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e85871-6918-4fdc-bddf-c7e4b7db0d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.203403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e85871-6918-4fdc-bddf-c7e4b7db0d01 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.225587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1099/2189] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:11 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:56:11.229574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e85871-6918-4fdc-bddf-c7e4b7db0d01 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:11.229744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ae03a-98e1-4cb8-80aa-826d26a935cf None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.233490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3f543-fe5b-474c-95e9-3b7788280e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.234184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f543-fe5b-474c-95e9-3b7788280e19 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.234467 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f543-fe5b-474c-95e9-3b7788280e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.234775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f543-fe5b-474c-95e9-3b7788280e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.239870 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e85871-6918-4fdc-bddf-c7e4b7db0d01 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.245182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3f543-fe5b-474c-95e9-3b7788280e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.245330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2edd-9487-49c0-b293-6e0010f9cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.245874 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2edd-9487-49c0-b293-6e0010f9cc09 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.246248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2edd-9487-49c0-b293-6e0010f9cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.246558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2edd-9487-49c0-b293-6e0010f9cc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.246654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3f543-fe5b-474c-95e9-3b7788280e19 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.247315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d2edd-9487-49c0-b293-6e0010f9cc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.248945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d2edd-9487-49c0-b293-6e0010f9cc09 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.256628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1091/2190] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:56:11.260650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1100/2191] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:11.264802 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3f543-fe5b-474c-95e9-3b7788280e19 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:11.274815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3f543-fe5b-474c-95e9-3b7788280e19 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.279459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d39c0-3ee8-467e-8514-1781b4645260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.280369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d39c0-3ee8-467e-8514-1781b4645260 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.280638 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d39c0-3ee8-467e-8514-1781b4645260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.280913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d39c0-3ee8-467e-8514-1781b4645260 admin admin] PATH_INFO: `/v3/projects/35f9722c58394d19a843d280501cf4f7/users/87e0055062bf4a0da7cff0f87e0a7f06/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.299050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d39c0-3ee8-467e-8514-1781b4645260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f9722c58394d19a843d280501cf4f7, user_id=87e0055062bf4a0da7cff0f87e0a7f06, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.301868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d39c0-3ee8-467e-8514-1781b4645260 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.318915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1092/2192] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:11 2022] PUT /identity/v3/projects/35f9722c58394d19a843d280501cf4f7/users/87e0055062bf4a0da7cff0f87e0a7f06/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:11.323794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2edd-9487-49c0-b293-6e0010f9cc09 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:11.336097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2edd-9487-49c0-b293-6e0010f9cc09 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.406382 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54a5a3-6f0e-4054-95fb-d1f07797938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.407450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a5a3-6f0e-4054-95fb-d1f07797938c admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.408125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a5a3-6f0e-4054-95fb-d1f07797938c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.408533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a5a3-6f0e-4054-95fb-d1f07797938c admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.409406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54a5a3-6f0e-4054-95fb-d1f07797938c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.411267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54a5a3-6f0e-4054-95fb-d1f07797938c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.427556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1101/2193] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:11.431985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d39c0-3ee8-467e-8514-1781b4645260 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:11.446117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d39c0-3ee8-467e-8514-1781b4645260 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.451591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaf5b2-af42-44d5-aa93-4f2d9a6b68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.452543 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaf5b2-af42-44d5-aa93-4f2d9a6b68b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.452846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaf5b2-af42-44d5-aa93-4f2d9a6b68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.453118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaf5b2-af42-44d5-aa93-4f2d9a6b68b8 admin admin] PATH_INFO: `/v3/projects/35f9722c58394d19a843d280501cf4f7/users/87e0055062bf4a0da7cff0f87e0a7f06/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.455709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaf5b2-af42-44d5-aa93-4f2d9a6b68b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f9722c58394d19a843d280501cf4f7, user_id=87e0055062bf4a0da7cff0f87e0a7f06, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.458439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaf5b2-af42-44d5-aa93-4f2d9a6b68b8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.470659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1093/2194] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:11 2022] PUT /identity/v3/projects/35f9722c58394d19a843d280501cf4f7/users/87e0055062bf4a0da7cff0f87e0a7f06/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:11.482774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5dcd-5b7b-4524-9d64-46456f4c22e7 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.483101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5dcd-5b7b-4524-9d64-46456f4c22e7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.483412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5dcd-5b7b-4524-9d64-46456f4c22e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.515456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-48bd5dcd-5b7b-4524-9d64-46456f4c22e7 None None] MFA Rules not processed for user `87e0055062bf4a0da7cff0f87e0a7f06`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:11.516788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-48bd5dcd-5b7b-4524-9d64-46456f4c22e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:11.607019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1102/2195] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:11.619535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaf5b2-af42-44d5-aa93-4f2d9a6b68b8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:11.621769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a8eaf5b2-af42-44d5-aa93-4f2d9a6b68b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:11.689443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaf5b2-af42-44d5-aa93-4f2d9a6b68b8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.697922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fa76d-5257-43cd-b24b-60fde7dd1600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.699531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fa76d-5257-43cd-b24b-60fde7dd1600 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.699908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fa76d-5257-43cd-b24b-60fde7dd1600 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.700258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fa76d-5257-43cd-b24b-60fde7dd1600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.712327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fa76d-5257-43cd-b24b-60fde7dd1600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.713793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fa76d-5257-43cd-b24b-60fde7dd1600 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.727561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1094/2196] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:11.827195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5dcd-5b7b-4524-9d64-46456f4c22e7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:11.832498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-48bd5dcd-5b7b-4524-9d64-46456f4c22e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:11.845250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fa76d-5257-43cd-b24b-60fde7dd1600 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:11.856011 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fa76d-5257-43cd-b24b-60fde7dd1600 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.863523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7937304-9981-4595-9427-364aac03944f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.864173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7937304-9981-4595-9427-364aac03944f service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.864455 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7937304-9981-4595-9427-364aac03944f service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.868508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7937304-9981-4595-9427-364aac03944f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.871019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a7937304-9981-4595-9427-364aac03944f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:11.920777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5dcd-5b7b-4524-9d64-46456f4c22e7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:11.926318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:11.927236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:11.927551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:11.927887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] PATH_INFO: `/v3/projects/112c04631d444bbb90e120df64ea6572` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:11.929250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] RBAC: Authorizing `identity:delete_project(project_id=112c04631d444bbb90e120df64ea6572)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.931433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.951695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7937304-9981-4595-9427-364aac03944f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:11.953224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7937304-9981-4595-9427-364aac03944f service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:11.977096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1095/2197] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:56:12.008638 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112c04631d444bbb90e120df64ea6572', 'request_id': 'req-4216bf83-ec1f-466b-8947-761216bc615f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.015428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112c04631d444bbb90e120df64ea6572', 'request_id': 'req-4216bf83-ec1f-466b-8947-761216bc615f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.024823 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112c04631d444bbb90e120df64ea6572', 'request_id': 'req-4216bf83-ec1f-466b-8947-761216bc615f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.040018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] The token cache is being invalidate because project 112c04631d444bbb90e120df64ea6572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:12.040407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.041232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.043273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1103/2198] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:11 2022] DELETE /identity/v3/projects/112c04631d444bbb90e120df64ea6572 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:12.047535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7937304-9981-4595-9427-364aac03944f service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:12.063616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7937304-9981-4595-9427-364aac03944f service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:12.143055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:12.144775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:12.145204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:12.145551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] PATH_INFO: `/v3/users/e06e206f940c4c0a9ce8992b2bf3d4cc` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:12.147790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06e206f940c4c0a9ce8992b2bf3d4cc)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:12.150391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:12.208820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06e206f940c4c0a9ce8992b2bf3d4cc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.209560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06e206f940c4c0a9ce8992b2bf3d4cc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.210594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06e206f940c4c0a9ce8992b2bf3d4cc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.220066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06e206f940c4c0a9ce8992b2bf3d4cc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.229886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cbad1035-d2b9-4149-94c3-92e383273b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06e206f940c4c0a9ce8992b2bf3d4cc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.255124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1096/2199] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:12 2022] DELETE /identity/v3/users/e06e206f940c4c0a9ce8992b2bf3d4cc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:12.612844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:12.615026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:12.633181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216bf83-ec1f-466b-8947-761216bc615f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:12.706390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:12.707205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:12.707514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:12.707845 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] PATH_INFO: `/v3/projects/d531779f5d394af7b1469c2ae555e0d3` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:12.709352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d531779f5d394af7b1469c2ae555e0d3)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:12.712070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:12.769372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd531779f5d394af7b1469c2ae555e0d3', 'request_id': 'req-c3eb98a5-9775-42b2-8c8e-7082f513df43'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.777522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd531779f5d394af7b1469c2ae555e0d3', 'request_id': 'req-c3eb98a5-9775-42b2-8c8e-7082f513df43'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.787102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd531779f5d394af7b1469c2ae555e0d3', 'request_id': 'req-c3eb98a5-9775-42b2-8c8e-7082f513df43'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.800757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] The token cache is being invalidate because project d531779f5d394af7b1469c2ae555e0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:12.801116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.801980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-c3eb98a5-9775-42b2-8c8e-7082f513df43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:12.804181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1104/2200] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:12 2022] DELETE /identity/v3/projects/d531779f5d394af7b1469c2ae555e0d3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:12.811115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8f51b-ab4e-4da2-9bb1-f1730519e560 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:12.811526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8f51b-ab4e-4da2-9bb1-f1730519e560 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:12.811894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8f51b-ab4e-4da2-9bb1-f1730519e560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:12.837859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0ba8f51b-ab4e-4da2-9bb1-f1730519e560 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:12.839406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0ba8f51b-ab4e-4da2-9bb1-f1730519e560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:12.921002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1097/2201] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:12.929216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2520-94ce-4828-9b8e-1965c152b350 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:12.929554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2520-94ce-4828-9b8e-1965c152b350 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:12.929878 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2520-94ce-4828-9b8e-1965c152b350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:12.959633 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-286d2520-94ce-4828-9b8e-1965c152b350 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:12.960956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-286d2520-94ce-4828-9b8e-1965c152b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:12.970226 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1105/2202] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:12.974825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8f51b-ab4e-4da2-9bb1-f1730519e560 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:12.991795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8f51b-ab4e-4da2-9bb1-f1730519e560 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.000418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed02f6b-c98d-4134-8fd4-109bf8ca05a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.001194 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed02f6b-c98d-4134-8fd4-109bf8ca05a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.001880 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed02f6b-c98d-4134-8fd4-109bf8ca05a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.002390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed02f6b-c98d-4134-8fd4-109bf8ca05a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.003645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed02f6b-c98d-4134-8fd4-109bf8ca05a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:13.004133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed02f6b-c98d-4134-8fd4-109bf8ca05a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.007060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed02f6b-c98d-4134-8fd4-109bf8ca05a7 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.027336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1098/2203] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:13.031712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2520-94ce-4828-9b8e-1965c152b350 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:13.041585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2520-94ce-4828-9b8e-1965c152b350 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.046546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58018a4-5bbf-4f8c-a315-1c9034310db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.047305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58018a4-5bbf-4f8c-a315-1c9034310db2 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.047621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58018a4-5bbf-4f8c-a315-1c9034310db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.047932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58018a4-5bbf-4f8c-a315-1c9034310db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.048713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58018a4-5bbf-4f8c-a315-1c9034310db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.050795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58018a4-5bbf-4f8c-a315-1c9034310db2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.079367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1106/2204] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:13 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:13.084596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed02f6b-c98d-4134-8fd4-109bf8ca05a7 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:13.097540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed02f6b-c98d-4134-8fd4-109bf8ca05a7 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.174159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdb0c1-fa5c-4216-a1c5-5e792cc78794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.174909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdb0c1-fa5c-4216-a1c5-5e792cc78794 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.175252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdb0c1-fa5c-4216-a1c5-5e792cc78794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.175546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdb0c1-fa5c-4216-a1c5-5e792cc78794 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.176408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdb0c1-fa5c-4216-a1c5-5e792cc78794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.179564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdb0c1-fa5c-4216-a1c5-5e792cc78794 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.206086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1099/2205] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:13 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:13.207340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58018a4-5bbf-4f8c-a315-1c9034310db2 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:13.225147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58018a4-5bbf-4f8c-a315-1c9034310db2 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.230828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73046f-f65b-4344-b05b-1410b16f3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.232518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73046f-f65b-4344-b05b-1410b16f3fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.233147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73046f-f65b-4344-b05b-1410b16f3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.233545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73046f-f65b-4344-b05b-1410b16f3fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.234551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73046f-f65b-4344-b05b-1410b16f3fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.236450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73046f-f65b-4344-b05b-1410b16f3fe1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.248036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1107/2206] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:13.252883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdb0c1-fa5c-4216-a1c5-5e792cc78794 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:13.264368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdb0c1-fa5c-4216-a1c5-5e792cc78794 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.269899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5868df-fa0c-4eea-8b80-43e40d0c60a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.270636 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5868df-fa0c-4eea-8b80-43e40d0c60a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.270924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5868df-fa0c-4eea-8b80-43e40d0c60a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.271204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5868df-fa0c-4eea-8b80-43e40d0c60a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.271948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5868df-fa0c-4eea-8b80-43e40d0c60a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.274074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5868df-fa0c-4eea-8b80-43e40d0c60a3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.290368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1100/2207] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:13.291597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73046f-f65b-4344-b05b-1410b16f3fe1 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:13.305801 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73046f-f65b-4344-b05b-1410b16f3fe1 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.310546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a8815-dd4c-46d2-89cf-ac8955511faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.311467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a8815-dd4c-46d2-89cf-ac8955511faa admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.311741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a8815-dd4c-46d2-89cf-ac8955511faa admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.312007 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a8815-dd4c-46d2-89cf-ac8955511faa admin admin] PATH_INFO: `/v3/projects/79a1cf8998d94fe0be9d27246423fa86/users/1f25e6abe5a64139ae6cdcef25b1045c/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.328800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a8815-dd4c-46d2-89cf-ac8955511faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a1cf8998d94fe0be9d27246423fa86, user_id=1f25e6abe5a64139ae6cdcef25b1045c, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.331736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a8815-dd4c-46d2-89cf-ac8955511faa admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.347778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1108/2208] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:13 2022] PUT /identity/v3/projects/79a1cf8998d94fe0be9d27246423fa86/users/1f25e6abe5a64139ae6cdcef25b1045c/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:13.363723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1fbfd-373a-421c-8f58-ad94b06790b5 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.364191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1fbfd-373a-421c-8f58-ad94b06790b5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.364713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1fbfd-373a-421c-8f58-ad94b06790b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.415493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b0a1fbfd-373a-421c-8f58-ad94b06790b5 None None] MFA Rules not processed for user `1f25e6abe5a64139ae6cdcef25b1045c`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:13.419261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b0a1fbfd-373a-421c-8f58-ad94b06790b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:13.551154 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1101/2209] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:13.556406 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a8815-dd4c-46d2-89cf-ac8955511faa admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:13.661650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a8815-dd4c-46d2-89cf-ac8955511faa admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.665758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ebb6f-32bc-4c30-8d79-0d3d9c5d05ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.666611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ebb6f-32bc-4c30-8d79-0d3d9c5d05ff admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.666959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ebb6f-32bc-4c30-8d79-0d3d9c5d05ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.667302 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ebb6f-32bc-4c30-8d79-0d3d9c5d05ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.668130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ebb6f-32bc-4c30-8d79-0d3d9c5d05ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.670954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ebb6f-32bc-4c30-8d79-0d3d9c5d05ff admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.707585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1109/2210] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:13 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:56:13.709715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1fbfd-373a-421c-8f58-ad94b06790b5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:13.723117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1fbfd-373a-421c-8f58-ad94b06790b5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.803898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f05f54-0719-4f54-9a31-105b725f23fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.804682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05f54-0719-4f54-9a31-105b725f23fd admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.804973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05f54-0719-4f54-9a31-105b725f23fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.805251 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f05f54-0719-4f54-9a31-105b725f23fd admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.806084 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f05f54-0719-4f54-9a31-105b725f23fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.808820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f05f54-0719-4f54-9a31-105b725f23fd admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.865862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1102/2211] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:13 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:56:13.872672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ebb6f-32bc-4c30-8d79-0d3d9c5d05ff admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:13.901991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ebb6f-32bc-4c30-8d79-0d3d9c5d05ff admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.910004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a83f73-5fce-493a-a9d1-d8859b756131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.910653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a83f73-5fce-493a-a9d1-d8859b756131 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.911007 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a83f73-5fce-493a-a9d1-d8859b756131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.911665 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a83f73-5fce-493a-a9d1-d8859b756131 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.913537 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a83f73-5fce-493a-a9d1-d8859b756131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.916318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a83f73-5fce-493a-a9d1-d8859b756131 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.932766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1110/2212] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:13.937404 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f05f54-0719-4f54-9a31-105b725f23fd admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:13.952670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f05f54-0719-4f54-9a31-105b725f23fd admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:13.954713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91defc-c47b-48a0-82a5-e5236f8c4d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:13.955752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91defc-c47b-48a0-82a5-e5236f8c4d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:13.956037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91defc-c47b-48a0-82a5-e5236f8c4d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:13.956321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91defc-c47b-48a0-82a5-e5236f8c4d35 admin admin] PATH_INFO: `/v3/projects/31508e8836fd402ca80e742146d01679/users/7fe3d3bb1b3c4c9e9b14144d183cc911/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:13.974490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91defc-c47b-48a0-82a5-e5236f8c4d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31508e8836fd402ca80e742146d01679, user_id=7fe3d3bb1b3c4c9e9b14144d183cc911, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:13.977339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91defc-c47b-48a0-82a5-e5236f8c4d35 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:13.993864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1103/2213] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:13 2022] PUT /identity/v3/projects/31508e8836fd402ca80e742146d01679/users/7fe3d3bb1b3c4c9e9b14144d183cc911/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:13.998116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a83f73-5fce-493a-a9d1-d8859b756131 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:14.014585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a83f73-5fce-493a-a9d1-d8859b756131 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:14.101179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe610499-c2e2-46ec-a69a-8cbb67152a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:14.103741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe610499-c2e2-46ec-a69a-8cbb67152a9b admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:14.104193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe610499-c2e2-46ec-a69a-8cbb67152a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:14.104645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe610499-c2e2-46ec-a69a-8cbb67152a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:14.106423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe610499-c2e2-46ec-a69a-8cbb67152a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:14.115361 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe610499-c2e2-46ec-a69a-8cbb67152a9b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:14.142905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1111/2214] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:14.148169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91defc-c47b-48a0-82a5-e5236f8c4d35 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:14.159003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91defc-c47b-48a0-82a5-e5236f8c4d35 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:14.170134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7be6e-87fd-4698-b3a1-96e4041d3725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:14.171174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7be6e-87fd-4698-b3a1-96e4041d3725 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:14.171526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7be6e-87fd-4698-b3a1-96e4041d3725 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:14.171869 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7be6e-87fd-4698-b3a1-96e4041d3725 admin admin] PATH_INFO: `/v3/projects/31508e8836fd402ca80e742146d01679/users/7fe3d3bb1b3c4c9e9b14144d183cc911/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:14.174252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7be6e-87fd-4698-b3a1-96e4041d3725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31508e8836fd402ca80e742146d01679, user_id=7fe3d3bb1b3c4c9e9b14144d183cc911, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:14.176935 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7be6e-87fd-4698-b3a1-96e4041d3725 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:14.189129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1104/2215] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:14 2022] PUT /identity/v3/projects/31508e8836fd402ca80e742146d01679/users/7fe3d3bb1b3c4c9e9b14144d183cc911/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:14.200628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37769303-aa70-4951-9653-b3889f6bc8df None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:14.200917 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37769303-aa70-4951-9653-b3889f6bc8df None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:14.201191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37769303-aa70-4951-9653-b3889f6bc8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:14.240624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-37769303-aa70-4951-9653-b3889f6bc8df None None] MFA Rules not processed for user `7fe3d3bb1b3c4c9e9b14144d183cc911`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:14.242146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-37769303-aa70-4951-9653-b3889f6bc8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:14.339270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1112/2216] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:14.350895 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7be6e-87fd-4698-b3a1-96e4041d3725 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:14.352903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-81d7be6e-87fd-4698-b3a1-96e4041d3725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:14.417136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7be6e-87fd-4698-b3a1-96e4041d3725 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:14.421485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf664411-16b1-4ea8-92ec-0a217df24eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:14.422180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf664411-16b1-4ea8-92ec-0a217df24eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:14.422472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf664411-16b1-4ea8-92ec-0a217df24eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:14.422747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf664411-16b1-4ea8-92ec-0a217df24eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:14.432942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf664411-16b1-4ea8-92ec-0a217df24eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:14.434436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf664411-16b1-4ea8-92ec-0a217df24eb6 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:14.448685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1105/2217] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:15.240468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37769303-aa70-4951-9653-b3889f6bc8df None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:15.340278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37769303-aa70-4951-9653-b3889f6bc8df None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:15.347182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:15.348070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:15.348345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:15.348609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] PATH_INFO: `/v3/users/1f25e6abe5a64139ae6cdcef25b1045c` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:15.349970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f25e6abe5a64139ae6cdcef25b1045c)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:15.352754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:15.452158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f25e6abe5a64139ae6cdcef25b1045c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:15.466560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f25e6abe5a64139ae6cdcef25b1045c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:15.480749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f25e6abe5a64139ae6cdcef25b1045c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:15.481726 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f25e6abe5a64139ae6cdcef25b1045c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:15.493736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f25e6abe5a64139ae6cdcef25b1045c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:15.510422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1113/2218] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:15 2022] DELETE /identity/v3/users/1f25e6abe5a64139ae6cdcef25b1045c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:15.512642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d58cb-4480-468f-b342-13b903821dc4 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:15.513155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d58cb-4480-468f-b342-13b903821dc4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:15.513262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d58cb-4480-468f-b342-13b903821dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:15.534548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9c4d58cb-4480-468f-b342-13b903821dc4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:15.535909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9c4d58cb-4480-468f-b342-13b903821dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:15.643285 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1106/2219] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:15.656889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:15.657856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:15.819572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d7547-8bad-400c-ab23-160ae67a565c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:15.825915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807474d-1c6d-492a-b84b-97566424c27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:15.825915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807474d-1c6d-492a-b84b-97566424c27a service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:15.826288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807474d-1c6d-492a-b84b-97566424c27a service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:15.826427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807474d-1c6d-492a-b84b-97566424c27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:15.843401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807474d-1c6d-492a-b84b-97566424c27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:15.845579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807474d-1c6d-492a-b84b-97566424c27a service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:15.862951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1114/2220] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:16.339528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d58cb-4480-468f-b342-13b903821dc4 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:16.341896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9c4d58cb-4480-468f-b342-13b903821dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:16.366132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d58cb-4480-468f-b342-13b903821dc4 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:16.376702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:16.378041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:16.378536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:16.378999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] PATH_INFO: `/v3/projects/79a1cf8998d94fe0be9d27246423fa86` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:16.382061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a1cf8998d94fe0be9d27246423fa86)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:16.385749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:16.448891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a1cf8998d94fe0be9d27246423fa86', 'request_id': 'req-f1643003-3d1c-4001-b46b-9b0307437dd2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.457128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a1cf8998d94fe0be9d27246423fa86', 'request_id': 'req-f1643003-3d1c-4001-b46b-9b0307437dd2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.465255 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a1cf8998d94fe0be9d27246423fa86', 'request_id': 'req-f1643003-3d1c-4001-b46b-9b0307437dd2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.480230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] The token cache is being invalidate because project 79a1cf8998d94fe0be9d27246423fa86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:16.481575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.482286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.484278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1107/2221] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:16 2022] DELETE /identity/v3/projects/79a1cf8998d94fe0be9d27246423fa86 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:16.489821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807474d-1c6d-492a-b84b-97566424c27a service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:16.503267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807474d-1c6d-492a-b84b-97566424c27a service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:16.591271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:16.592447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:16.592727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:16.593001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] PATH_INFO: `/v3/users/7fe3d3bb1b3c4c9e9b14144d183cc911` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:16.594594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe3d3bb1b3c4c9e9b14144d183cc911)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:16.596486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:16.658676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe3d3bb1b3c4c9e9b14144d183cc911'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.674109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe3d3bb1b3c4c9e9b14144d183cc911'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.688024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe3d3bb1b3c4c9e9b14144d183cc911'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.689156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe3d3bb1b3c4c9e9b14144d183cc911'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.702728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe3d3bb1b3c4c9e9b14144d183cc911'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:16.713691 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1115/2222] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:16 2022] DELETE /identity/v3/users/7fe3d3bb1b3c4c9e9b14144d183cc911 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:17.137217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:17.139016 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:17.153835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1643003-3d1c-4001-b46b-9b0307437dd2 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:17.235358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:17.236240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:17.236518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:17.236789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] PATH_INFO: `/v3/projects/31508e8836fd402ca80e742146d01679` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:17.238116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31508e8836fd402ca80e742146d01679)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:17.241237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:17.349120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31508e8836fd402ca80e742146d01679', 'request_id': 'req-0a9f0300-94fe-44b9-987a-9a7e9038581e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.362763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31508e8836fd402ca80e742146d01679', 'request_id': 'req-0a9f0300-94fe-44b9-987a-9a7e9038581e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.378280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31508e8836fd402ca80e742146d01679', 'request_id': 'req-0a9f0300-94fe-44b9-987a-9a7e9038581e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.414286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] The token cache is being invalidate because project 31508e8836fd402ca80e742146d01679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:17.414629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.417683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:17.423450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:17.435171 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0a9f0300-94fe-44b9-987a-9a7e9038581e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.440596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1108/2223] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:17 2022] DELETE /identity/v3/projects/31508e8836fd402ca80e742146d01679 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:17.442220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff40d6-fdad-40e6-94ba-4dbb52e95c0f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:17.442508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff40d6-fdad-40e6-94ba-4dbb52e95c0f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:17.442784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff40d6-fdad-40e6-94ba-4dbb52e95c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:17.445538 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c290d-1bc3-4f9a-a550-a8dc747e6c22 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:17.472539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0aff40d6-fdad-40e6-94ba-4dbb52e95c0f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:17.473796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0aff40d6-fdad-40e6-94ba-4dbb52e95c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:17.553208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:17.554202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:17.554509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:17.554771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] PATH_INFO: `/v3/users/37746ea4146b445eb9ce484d10e26241` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:17.556116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37746ea4146b445eb9ce484d10e26241)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:17.560212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:17.570392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1109/2224] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:17.572059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9fdd-acca-489f-8076-81fd501f6e8f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:17.572352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9fdd-acca-489f-8076-81fd501f6e8f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:17.572670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9fdd-acca-489f-8076-81fd501f6e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:17.609426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6efe9fdd-acca-489f-8076-81fd501f6e8f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:17.615803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6efe9fdd-acca-489f-8076-81fd501f6e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:17.636837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37746ea4146b445eb9ce484d10e26241'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.640678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1110/2225] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:17.642292 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe9fdd-acca-489f-8076-81fd501f6e8f None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:17.659413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe9fdd-acca-489f-8076-81fd501f6e8f None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:17.664951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37746ea4146b445eb9ce484d10e26241'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.668607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d48719-a357-438c-b4b8-0b37808d994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:17.670330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d48719-a357-438c-b4b8-0b37808d994f admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:17.670825 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d48719-a357-438c-b4b8-0b37808d994f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:17.671194 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d48719-a357-438c-b4b8-0b37808d994f admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:17.672127 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d48719-a357-438c-b4b8-0b37808d994f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:17.672460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d48719-a357-438c-b4b8-0b37808d994f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:17.674521 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d48719-a357-438c-b4b8-0b37808d994f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:17.677763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37746ea4146b445eb9ce484d10e26241'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.678720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37746ea4146b445eb9ce484d10e26241'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.692241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1111/2226] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:17.699796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d48719-a357-438c-b4b8-0b37808d994f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:17.711111 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4e09034-8f2a-4103-a3d7-5c5801e51125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37746ea4146b445eb9ce484d10e26241'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:17.717458 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d48719-a357-438c-b4b8-0b37808d994f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:17.724087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1116/2227] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:17 2022] DELETE /identity/v3/users/37746ea4146b445eb9ce484d10e26241 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:17.726360 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73e7ff-8d83-4ad5-be3d-7ca0aad80f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:17.727575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73e7ff-8d83-4ad5-be3d-7ca0aad80f07 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:17.728037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73e7ff-8d83-4ad5-be3d-7ca0aad80f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:17.728729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73e7ff-8d83-4ad5-be3d-7ca0aad80f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:17.731217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73e7ff-8d83-4ad5-be3d-7ca0aad80f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:17.731401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbb2d5-d907-4d3b-aadf-bb26575ea305 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:17.731401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbb2d5-d907-4d3b-aadf-bb26575ea305 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:17.731401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbb2d5-d907-4d3b-aadf-bb26575ea305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:17.733278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73e7ff-8d83-4ad5-be3d-7ca0aad80f07 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:17.770042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-1fcbb2d5-d907-4d3b-aadf-bb26575ea305 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:17.774499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1fcbb2d5-d907-4d3b-aadf-bb26575ea305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:17.795205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1112/2228] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:17 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:17.797071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73e7ff-8d83-4ad5-be3d-7ca0aad80f07 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:17.799957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9b73e7ff-8d83-4ad5-be3d-7ca0aad80f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:17.885463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1117/2229] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:17.906973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbb2d5-d907-4d3b-aadf-bb26575ea305 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:17.909478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1fcbb2d5-d907-4d3b-aadf-bb26575ea305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:17.959791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73e7ff-8d83-4ad5-be3d-7ca0aad80f07 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:17.977721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc18617-ec49-4ff2-b9f4-baf175bcdb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:17.979577 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc18617-ec49-4ff2-b9f4-baf175bcdb51 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:17.980415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc18617-ec49-4ff2-b9f4-baf175bcdb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:17.981331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc18617-ec49-4ff2-b9f4-baf175bcdb51 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:17.983424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc18617-ec49-4ff2-b9f4-baf175bcdb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:17.989581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc18617-ec49-4ff2-b9f4-baf175bcdb51 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:18.025021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbb2d5-d907-4d3b-aadf-bb26575ea305 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:18.029813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1113/2230] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:17 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:56:18.035427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc18617-ec49-4ff2-b9f4-baf175bcdb51 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:18.047123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc18617-ec49-4ff2-b9f4-baf175bcdb51 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:18.053606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f92c-91d3-4a2a-b989-7be8aa47b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:18.055216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f92c-91d3-4a2a-b989-7be8aa47b1ab admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:18.055941 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f92c-91d3-4a2a-b989-7be8aa47b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:18.057026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f92c-91d3-4a2a-b989-7be8aa47b1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:18.058086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f92c-91d3-4a2a-b989-7be8aa47b1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:18.060901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f92c-91d3-4a2a-b989-7be8aa47b1ab admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:18.076126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1114/2231] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:18.082052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f92c-91d3-4a2a-b989-7be8aa47b1ab admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:18.099536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f92c-91d3-4a2a-b989-7be8aa47b1ab admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:18.105719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e41ebb-d01e-433f-921c-61eb794ddc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:18.106424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41ebb-d01e-433f-921c-61eb794ddc8a admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:18.106729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41ebb-d01e-433f-921c-61eb794ddc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:18.106996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41ebb-d01e-433f-921c-61eb794ddc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:18.107819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e41ebb-d01e-433f-921c-61eb794ddc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:18.110398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e41ebb-d01e-433f-921c-61eb794ddc8a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:18.110725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0426d3-bbb4-4068-ba1e-14f78b505754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:18.111821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0426d3-bbb4-4068-ba1e-14f78b505754 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:18.112320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0426d3-bbb4-4068-ba1e-14f78b505754 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:18.113595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0426d3-bbb4-4068-ba1e-14f78b505754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:18.128388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1115/2232] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:18.130834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e41ebb-d01e-433f-921c-61eb794ddc8a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:18.131373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0426d3-bbb4-4068-ba1e-14f78b505754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:18.133358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0426d3-bbb4-4068-ba1e-14f78b505754 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:18.148410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1118/2233] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:56:18.149009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e41ebb-d01e-433f-921c-61eb794ddc8a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:18.157662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d8da-d14a-4792-9eb3-802cbd3af882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:18.159504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d8da-d14a-4792-9eb3-802cbd3af882 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:18.159995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d8da-d14a-4792-9eb3-802cbd3af882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:18.160493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d8da-d14a-4792-9eb3-802cbd3af882 admin admin] PATH_INFO: `/v3/projects/fb2a0806ce2e4cc7bca3bc1d39dd493f/users/f8b079491a484b63ae90c7c601bc1e38/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:18.191033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96d8da-d14a-4792-9eb3-802cbd3af882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2a0806ce2e4cc7bca3bc1d39dd493f, user_id=f8b079491a484b63ae90c7c601bc1e38, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:18.193744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96d8da-d14a-4792-9eb3-802cbd3af882 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:18.211178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1116/2234] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:18 2022] PUT /identity/v3/projects/fb2a0806ce2e4cc7bca3bc1d39dd493f/users/f8b079491a484b63ae90c7c601bc1e38/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:18.223234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970767-f931-4898-82e1-0fe1a9719c4a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:18.223524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970767-f931-4898-82e1-0fe1a9719c4a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:18.223908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970767-f931-4898-82e1-0fe1a9719c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:18.259215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-0e970767-f931-4898-82e1-0fe1a9719c4a None None] MFA Rules not processed for user `f8b079491a484b63ae90c7c601bc1e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:18.260728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0e970767-f931-4898-82e1-0fe1a9719c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:18.357680 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1119/2235] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:18.373491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d8da-d14a-4792-9eb3-802cbd3af882 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:18.376520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-dc96d8da-d14a-4792-9eb3-802cbd3af882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:18.541709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d8da-d14a-4792-9eb3-802cbd3af882 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:18.545435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b291c6-ff26-4e88-a9f6-6ecf4fab7209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:18.546124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b291c6-ff26-4e88-a9f6-6ecf4fab7209 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:18.546411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b291c6-ff26-4e88-a9f6-6ecf4fab7209 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:18.546685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b291c6-ff26-4e88-a9f6-6ecf4fab7209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:18.556130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b291c6-ff26-4e88-a9f6-6ecf4fab7209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:18.557597 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b291c6-ff26-4e88-a9f6-6ecf4fab7209 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:18.569467 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1117/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:18.658257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e970767-f931-4898-82e1-0fe1a9719c4a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:18.660694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0e970767-f931-4898-82e1-0fe1a9719c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:18.744936 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e970767-f931-4898-82e1-0fe1a9719c4a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:18.751018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:18.752844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:18.752844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:18.753972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] PATH_INFO: `/v3/projects/7ff9eb7715514b1bb6be7bf301d90b42` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:18.756301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff9eb7715514b1bb6be7bf301d90b42)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:18.758477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:18.871441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff9eb7715514b1bb6be7bf301d90b42', 'request_id': 'req-dc93abca-5b5f-4755-9e81-cf581d9610b8'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:18.878099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff9eb7715514b1bb6be7bf301d90b42', 'request_id': 'req-dc93abca-5b5f-4755-9e81-cf581d9610b8'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:18.903895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff9eb7715514b1bb6be7bf301d90b42', 'request_id': 'req-dc93abca-5b5f-4755-9e81-cf581d9610b8'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:18.941832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] The token cache is being invalidate because project 7ff9eb7715514b1bb6be7bf301d90b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:18.942397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:18.943222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:18.945392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1120/2237] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:18 2022] DELETE /identity/v3/projects/7ff9eb7715514b1bb6be7bf301d90b42 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:18.949642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b291c6-ff26-4e88-a9f6-6ecf4fab7209 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:18.964229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b291c6-ff26-4e88-a9f6-6ecf4fab7209 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:19.060203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:19.061644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:19.062125 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:19.062311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] PATH_INFO: `/v3/users/87e0055062bf4a0da7cff0f87e0a7f06` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:19.063766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e0055062bf4a0da7cff0f87e0a7f06)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:19.065897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:19.137707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e0055062bf4a0da7cff0f87e0a7f06'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.138626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e0055062bf4a0da7cff0f87e0a7f06'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.139374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e0055062bf4a0da7cff0f87e0a7f06'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.150201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e0055062bf4a0da7cff0f87e0a7f06'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.160115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-746ec630-eaf5-49ab-b091-e1e62358b4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e0055062bf4a0da7cff0f87e0a7f06'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.184018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1118/2238] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:18 2022] DELETE /identity/v3/users/87e0055062bf4a0da7cff0f87e0a7f06 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:19.558386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:19.559743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:19.575072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93abca-5b5f-4755-9e81-cf581d9610b8 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:19.666401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:19.667301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:19.667588 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:19.668477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] PATH_INFO: `/v3/projects/35f9722c58394d19a843d280501cf4f7` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:19.669837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f9722c58394d19a843d280501cf4f7)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:19.672111 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:19.722273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f9722c58394d19a843d280501cf4f7', 'request_id': 'req-26e81139-9444-4f0e-a9f1-1f5213f4a516'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.728433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f9722c58394d19a843d280501cf4f7', 'request_id': 'req-26e81139-9444-4f0e-a9f1-1f5213f4a516'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.742720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f9722c58394d19a843d280501cf4f7', 'request_id': 'req-26e81139-9444-4f0e-a9f1-1f5213f4a516'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.763478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] The token cache is being invalidate because project 35f9722c58394d19a843d280501cf4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:19.763749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.764757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-26e81139-9444-4f0e-a9f1-1f5213f4a516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:19.767741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1121/2239] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:19 2022] DELETE /identity/v3/projects/35f9722c58394d19a843d280501cf4f7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:19.772870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0bca0-fcb1-45e3-969f-07c160205f35 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:19.773261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0bca0-fcb1-45e3-969f-07c160205f35 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:19.773556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0bca0-fcb1-45e3-969f-07c160205f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:19.796306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-28b0bca0-fcb1-45e3-969f-07c160205f35 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:19.797693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-28b0bca0-fcb1-45e3-969f-07c160205f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:19.898610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1119/2240] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:19.910979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b4b0-75d0-4fd6-9547-1669d9563592 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:19.911527 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b4b0-75d0-4fd6-9547-1669d9563592 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:19.912067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0b4b0-75d0-4fd6-9547-1669d9563592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:19.952227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e6f0b4b0-75d0-4fd6-9547-1669d9563592 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:19.953619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e6f0b4b0-75d0-4fd6-9547-1669d9563592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:19.963441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1122/2241] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:19.968201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0bca0-fcb1-45e3-969f-07c160205f35 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:19.979805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0bca0-fcb1-45e3-969f-07c160205f35 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:19.985968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828c21a-974b-4b4e-bb79-0e5c23092d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:19.986648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828c21a-974b-4b4e-bb79-0e5c23092d17 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:19.986900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828c21a-974b-4b4e-bb79-0e5c23092d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:19.987207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828c21a-974b-4b4e-bb79-0e5c23092d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:19.987946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828c21a-974b-4b4e-bb79-0e5c23092d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:19.988260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828c21a-974b-4b4e-bb79-0e5c23092d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:19.990115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828c21a-974b-4b4e-bb79-0e5c23092d17 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.012717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1120/2242] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:20.013897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b4b0-75d0-4fd6-9547-1669d9563592 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.025011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0b4b0-75d0-4fd6-9547-1669d9563592 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:20.030038 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e95f5a-2242-4337-949b-f974eff88d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:20.030817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e95f5a-2242-4337-949b-f974eff88d81 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.031161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e95f5a-2242-4337-949b-f974eff88d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.031505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e95f5a-2242-4337-949b-f974eff88d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.032321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e95f5a-2242-4337-949b-f974eff88d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:20.035614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e95f5a-2242-4337-949b-f974eff88d81 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.078554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828c21a-974b-4b4e-bb79-0e5c23092d17 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.079684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1123/2243] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:20 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:20.090893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828c21a-974b-4b4e-bb79-0e5c23092d17 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:20.162118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989881ff-b20e-45a1-827a-4fbf98fd700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:20.163940 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989881ff-b20e-45a1-827a-4fbf98fd700b admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.163940 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989881ff-b20e-45a1-827a-4fbf98fd700b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.163940 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989881ff-b20e-45a1-827a-4fbf98fd700b admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.164328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989881ff-b20e-45a1-827a-4fbf98fd700b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:20.166414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989881ff-b20e-45a1-827a-4fbf98fd700b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.215372 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1121/2244] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:20 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:20.219859 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e95f5a-2242-4337-949b-f974eff88d81 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.234800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e95f5a-2242-4337-949b-f974eff88d81 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:20.240307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd00dc4-d9be-4a83-99a9-02fdba797045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:20.241282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00dc4-d9be-4a83-99a9-02fdba797045 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.241836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00dc4-d9be-4a83-99a9-02fdba797045 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.242356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00dc4-d9be-4a83-99a9-02fdba797045 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.243183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd00dc4-d9be-4a83-99a9-02fdba797045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:20.244943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd00dc4-d9be-4a83-99a9-02fdba797045 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.259990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1124/2245] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:20.261644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989881ff-b20e-45a1-827a-4fbf98fd700b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.275668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989881ff-b20e-45a1-827a-4fbf98fd700b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:20.281123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3d8d5-e40d-46c0-bda4-fd1b0a9efd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:20.281803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d8d5-e40d-46c0-bda4-fd1b0a9efd10 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.282166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d8d5-e40d-46c0-bda4-fd1b0a9efd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.282442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3d8d5-e40d-46c0-bda4-fd1b0a9efd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.283190 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d8d5-e40d-46c0-bda4-fd1b0a9efd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:20.284792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3d8d5-e40d-46c0-bda4-fd1b0a9efd10 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.296280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1122/2246] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:20.301467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd00dc4-d9be-4a83-99a9-02fdba797045 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.313263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd00dc4-d9be-4a83-99a9-02fdba797045 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:20.322109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e9d05-52e4-4722-a2e1-1d8c1580b8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:20.324025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e9d05-52e4-4722-a2e1-1d8c1580b8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.324025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e9d05-52e4-4722-a2e1-1d8c1580b8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.324204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e9d05-52e4-4722-a2e1-1d8c1580b8ff admin admin] PATH_INFO: `/v3/projects/08c2c609658c43c4b0ed927792fbc3d0/users/b7b525ada76b4481b1249ffee4e7548b/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.347380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e9d05-52e4-4722-a2e1-1d8c1580b8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c2c609658c43c4b0ed927792fbc3d0, user_id=b7b525ada76b4481b1249ffee4e7548b, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:20.351375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e9d05-52e4-4722-a2e1-1d8c1580b8ff admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.369846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1125/2247] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:20 2022] PUT /identity/v3/projects/08c2c609658c43c4b0ed927792fbc3d0/users/b7b525ada76b4481b1249ffee4e7548b/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:20.384294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e544b5-6c9c-4b8c-b41a-aabf43f95b68 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.384611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e544b5-6c9c-4b8c-b41a-aabf43f95b68 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.384850 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e544b5-6c9c-4b8c-b41a-aabf43f95b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.416571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b0e544b5-6c9c-4b8c-b41a-aabf43f95b68 None None] MFA Rules not processed for user `b7b525ada76b4481b1249ffee4e7548b`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:20.417716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b0e544b5-6c9c-4b8c-b41a-aabf43f95b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:20.536666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1123/2248] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:20.544844 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e9d05-52e4-4722-a2e1-1d8c1580b8ff admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.644315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e9d05-52e4-4722-a2e1-1d8c1580b8ff admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:20.651319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d962e-f10b-4362-939c-c42591224209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:20.652437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d962e-f10b-4362-939c-c42591224209 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.652721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d962e-f10b-4362-939c-c42591224209 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.653000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d962e-f10b-4362-939c-c42591224209 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.653717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d962e-f10b-4362-939c-c42591224209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:20.655768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d962e-f10b-4362-939c-c42591224209 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.691035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1126/2249] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:20 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:20.696338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e544b5-6c9c-4b8c-b41a-aabf43f95b68 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.708021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e544b5-6c9c-4b8c-b41a-aabf43f95b68 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:20.786518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480516a-4112-4bee-980e-052cfc7fef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:20.787633 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480516a-4112-4bee-980e-052cfc7fef64 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.788253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480516a-4112-4bee-980e-052cfc7fef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.788721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480516a-4112-4bee-980e-052cfc7fef64 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.789970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480516a-4112-4bee-980e-052cfc7fef64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:20.793504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480516a-4112-4bee-980e-052cfc7fef64 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.816672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1124/2250] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:20 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:20.824444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d962e-f10b-4362-939c-c42591224209 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.842931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d962e-f10b-4362-939c-c42591224209 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:20.847795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a987d8-0ecc-4aa0-943f-844992758b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:20.848488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a987d8-0ecc-4aa0-943f-844992758b42 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.848771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a987d8-0ecc-4aa0-943f-844992758b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.849049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a987d8-0ecc-4aa0-943f-844992758b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.849787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a987d8-0ecc-4aa0-943f-844992758b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:20.851485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a987d8-0ecc-4aa0-943f-844992758b42 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.862555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1127/2251] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:20.867616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480516a-4112-4bee-980e-052cfc7fef64 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.878139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480516a-4112-4bee-980e-052cfc7fef64 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:20.883519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28029bd4-5f79-4785-a39c-644cdfcdfa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:20.884909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28029bd4-5f79-4785-a39c-644cdfcdfa19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:20.885101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28029bd4-5f79-4785-a39c-644cdfcdfa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:20.885371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28029bd4-5f79-4785-a39c-644cdfcdfa19 admin admin] PATH_INFO: `/v3/projects/983f0441473d4d268406d2e7e51c9410/users/60b4aaa65b2a43ed8dc24707312e7657/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:20.905484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28029bd4-5f79-4785-a39c-644cdfcdfa19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983f0441473d4d268406d2e7e51c9410, user_id=60b4aaa65b2a43ed8dc24707312e7657, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:20.908359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28029bd4-5f79-4785-a39c-644cdfcdfa19 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:20.930979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1125/2252] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:20 2022] PUT /identity/v3/projects/983f0441473d4d268406d2e7e51c9410/users/60b4aaa65b2a43ed8dc24707312e7657/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:20.932131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a987d8-0ecc-4aa0-943f-844992758b42 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:20.944744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a987d8-0ecc-4aa0-943f-844992758b42 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:21.006536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df7b8-fe1f-4cd3-b456-e0ecb157a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:21.007214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df7b8-fe1f-4cd3-b456-e0ecb157a65a admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:21.007497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df7b8-fe1f-4cd3-b456-e0ecb157a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:21.007780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df7b8-fe1f-4cd3-b456-e0ecb157a65a admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:21.008505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04df7b8-fe1f-4cd3-b456-e0ecb157a65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:21.010162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04df7b8-fe1f-4cd3-b456-e0ecb157a65a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:21.020455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1128/2253] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:21.026226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28029bd4-5f79-4785-a39c-644cdfcdfa19 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:21.039003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28029bd4-5f79-4785-a39c-644cdfcdfa19 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:21.047051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db01235-1d5f-4a00-b7a9-0b869b681cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:21.048363 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db01235-1d5f-4a00-b7a9-0b869b681cae admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:21.048813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db01235-1d5f-4a00-b7a9-0b869b681cae admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:21.049274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db01235-1d5f-4a00-b7a9-0b869b681cae admin admin] PATH_INFO: `/v3/projects/983f0441473d4d268406d2e7e51c9410/users/60b4aaa65b2a43ed8dc24707312e7657/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:21.052437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db01235-1d5f-4a00-b7a9-0b869b681cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=983f0441473d4d268406d2e7e51c9410, user_id=60b4aaa65b2a43ed8dc24707312e7657, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:21.055849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db01235-1d5f-4a00-b7a9-0b869b681cae admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:21.067499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1126/2254] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:21 2022] PUT /identity/v3/projects/983f0441473d4d268406d2e7e51c9410/users/60b4aaa65b2a43ed8dc24707312e7657/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:21.078498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a74e45-85d9-41a6-8b02-daf33ee13bf1 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:21.078758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a74e45-85d9-41a6-8b02-daf33ee13bf1 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:21.079086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a74e45-85d9-41a6-8b02-daf33ee13bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:21.110488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-81a74e45-85d9-41a6-8b02-daf33ee13bf1 None None] MFA Rules not processed for user `60b4aaa65b2a43ed8dc24707312e7657`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:21.111777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-81a74e45-85d9-41a6-8b02-daf33ee13bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:21.188579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1129/2255] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:21.199716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db01235-1d5f-4a00-b7a9-0b869b681cae admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:21.202003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6db01235-1d5f-4a00-b7a9-0b869b681cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:21.291273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db01235-1d5f-4a00-b7a9-0b869b681cae admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:21.295548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a12ae3-6699-48dd-bf3a-014945e66ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:21.296575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a12ae3-6699-48dd-bf3a-014945e66ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:21.297029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a12ae3-6699-48dd-bf3a-014945e66ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:21.297486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a12ae3-6699-48dd-bf3a-014945e66ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:21.381869 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a12ae3-6699-48dd-bf3a-014945e66ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:21.383581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a12ae3-6699-48dd-bf3a-014945e66ae8 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:21.393787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1127/2256] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:32.426710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b3858-cc91-4838-ab0b-dcab2fa6a05f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:32.427631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b3858-cc91-4838-ab0b-dcab2fa6a05f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:32.427631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b3858-cc91-4838-ab0b-dcab2fa6a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:32.445985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-b10b3858-cc91-4838-ab0b-dcab2fa6a05f None None] MFA Rules not processed for user `0207c3cb9a3e408f81ff3f86c5e70285`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:32.447139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b10b3858-cc91-4838-ab0b-dcab2fa6a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:32.505526 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1130/2257] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:32.914383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183558f-92cb-430f-9d15-b66669d7961f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:32.915182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183558f-92cb-430f-9d15-b66669d7961f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:32.915182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183558f-92cb-430f-9d15-b66669d7961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:32.956783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4183558f-92cb-430f-9d15-b66669d7961f None None] MFA Rules not processed for user `c2e837368cdc4df29d945a4c8e662a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:32.959097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4183558f-92cb-430f-9d15-b66669d7961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:33.022886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1128/2258] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 19:56:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:33.035051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b3858-cc91-4838-ab0b-dcab2fa6a05f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:33.036843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b10b3858-cc91-4838-ab0b-dcab2fa6a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:33.049288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b3858-cc91-4838-ab0b-dcab2fa6a05f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:33.053365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4680b41-b2b5-475e-a2a3-a293eea2b0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:33.053911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4680b41-b2b5-475e-a2a3-a293eea2b0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:33.054231 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4680b41-b2b5-475e-a2a3-a293eea2b0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:33.054500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4680b41-b2b5-475e-a2a3-a293eea2b0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:33.062136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4680b41-b2b5-475e-a2a3-a293eea2b0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:33.063573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4680b41-b2b5-475e-a2a3-a293eea2b0c2 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:33.072603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1131/2259] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:35.410814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183558f-92cb-430f-9d15-b66669d7961f None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:35.412387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4183558f-92cb-430f-9d15-b66669d7961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:35.507131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183558f-92cb-430f-9d15-b66669d7961f None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:35.512988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb8684-94fb-4ccc-be16-3738f348b155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:35.513617 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb8684-94fb-4ccc-be16-3738f348b155 service placement] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:35.513899 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb8684-94fb-4ccc-be16-3738f348b155 service placement] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:35.514205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb8684-94fb-4ccc-be16-3738f348b155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:35.516081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-95bb8684-94fb-4ccc-be16-3738f348b155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:35.527468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb8684-94fb-4ccc-be16-3738f348b155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:35.529029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb8684-94fb-4ccc-be16-3738f348b155 service placement] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:35.538901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1129/2260] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:40.584270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4680b41-b2b5-475e-a2a3-a293eea2b0c2 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:40.594550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4680b41-b2b5-475e-a2a3-a293eea2b0c2 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:40.598331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137ccc8-e896-4041-98d3-3928e5d896ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:40.598973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137ccc8-e896-4041-98d3-3928e5d896ec service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:40.599254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137ccc8-e896-4041-98d3-3928e5d896ec service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:40.599531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137ccc8-e896-4041-98d3-3928e5d896ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:40.609064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137ccc8-e896-4041-98d3-3928e5d896ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:40.610537 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137ccc8-e896-4041-98d3-3928e5d896ec service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:40.620025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1132/2261] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:51.861119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb8684-94fb-4ccc-be16-3738f348b155 service placement] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:51.946094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb8684-94fb-4ccc-be16-3738f348b155 service placement] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:51.951438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:51.952323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:51.952770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:51.953042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] PATH_INFO: `/v3/users/b7b525ada76b4481b1249ffee4e7548b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:51.954380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b525ada76b4481b1249ffee4e7548b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:51.956349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:52.010706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b525ada76b4481b1249ffee4e7548b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.011717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b525ada76b4481b1249ffee4e7548b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.012463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b525ada76b4481b1249ffee4e7548b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.020846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b525ada76b4481b1249ffee4e7548b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.031200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b525ada76b4481b1249ffee4e7548b'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.050796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1130/2262] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:51 2022] DELETE /identity/v3/users/b7b525ada76b4481b1249ffee4e7548b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:52.055814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e4443-c5b0-4bb4-a210-be0bfc275c78 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:52.056394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e4443-c5b0-4bb4-a210-be0bfc275c78 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:52.056394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e4443-c5b0-4bb4-a210-be0bfc275c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:52.076832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-0d6e4443-c5b0-4bb4-a210-be0bfc275c78 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:52.078142 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0d6e4443-c5b0-4bb4-a210-be0bfc275c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:52.149253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1133/2263] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:52.159879 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:52.161506 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:52.223995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc43d5f-d4d5-4ba9-a775-973423a249ee admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:52.228478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd404b-e0d4-43e0-9817-6951d35054dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:52.229150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd404b-e0d4-43e0-9817-6951d35054dd service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:52.229418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd404b-e0d4-43e0-9817-6951d35054dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:52.229690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd404b-e0d4-43e0-9817-6951d35054dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:52.242266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd404b-e0d4-43e0-9817-6951d35054dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:52.244421 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd404b-e0d4-43e0-9817-6951d35054dd service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:52.260719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1131/2264] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:52.368609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e4443-c5b0-4bb4-a210-be0bfc275c78 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:52.370738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0d6e4443-c5b0-4bb4-a210-be0bfc275c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:52.404761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e4443-c5b0-4bb4-a210-be0bfc275c78 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:52.410905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:52.412121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:52.412583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:52.412831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] PATH_INFO: `/v3/users/f8b079491a484b63ae90c7c601bc1e38` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:52.414347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b079491a484b63ae90c7c601bc1e38)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:52.416449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:52.473895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b079491a484b63ae90c7c601bc1e38'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.487025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b079491a484b63ae90c7c601bc1e38'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.503910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b079491a484b63ae90c7c601bc1e38'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.505060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b079491a484b63ae90c7c601bc1e38'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.514629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b079491a484b63ae90c7c601bc1e38'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.521594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1134/2265] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:52 2022] DELETE /identity/v3/users/f8b079491a484b63ae90c7c601bc1e38 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:52.526667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8cf59-13ac-4a42-8df2-1d326a5d6b06 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:52.526969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8cf59-13ac-4a42-8df2-1d326a5d6b06 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:52.527236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8cf59-13ac-4a42-8df2-1d326a5d6b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:52.547854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-16d8cf59-13ac-4a42-8df2-1d326a5d6b06 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:52.549234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-16d8cf59-13ac-4a42-8df2-1d326a5d6b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:52.626526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1132/2266] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:52.640028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:52.641596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:52.667105 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8cf59-13ac-4a42-8df2-1d326a5d6b06 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:52.669785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-16d8cf59-13ac-4a42-8df2-1d326a5d6b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:52.681644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8cf59-13ac-4a42-8df2-1d326a5d6b06 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:52.687102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:52.687946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:52.688225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:52.688502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] PATH_INFO: `/v3/projects/08c2c609658c43c4b0ed927792fbc3d0` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:52.689750 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c2c609658c43c4b0ed927792fbc3d0)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:52.691785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:52.706515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2fdca-8148-4328-8f41-2e074b087271 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:52.710791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4480f05-a0dd-4ecc-96f9-9875de8e94cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:52.711930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4480f05-a0dd-4ecc-96f9-9875de8e94cd service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:52.712210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4480f05-a0dd-4ecc-96f9-9875de8e94cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:52.712486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4480f05-a0dd-4ecc-96f9-9875de8e94cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:52.723057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4480f05-a0dd-4ecc-96f9-9875de8e94cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:52.724788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4480f05-a0dd-4ecc-96f9-9875de8e94cd service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:52.735208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1135/2267] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:52.746273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c2c609658c43c4b0ed927792fbc3d0', 'request_id': 'req-8fc9911d-46e1-48af-9e01-081da8ba1541'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.752327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c2c609658c43c4b0ed927792fbc3d0', 'request_id': 'req-8fc9911d-46e1-48af-9e01-081da8ba1541'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.759178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c2c609658c43c4b0ed927792fbc3d0', 'request_id': 'req-8fc9911d-46e1-48af-9e01-081da8ba1541'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.773457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] The token cache is being invalidate because project 08c2c609658c43c4b0ed927792fbc3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:52.773803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.774523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.776144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1133/2268] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:52 2022] DELETE /identity/v3/projects/08c2c609658c43c4b0ed927792fbc3d0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:52.780209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4480f05-a0dd-4ecc-96f9-9875de8e94cd service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:52.791000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4480f05-a0dd-4ecc-96f9-9875de8e94cd service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:52.862675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:52.863821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:52.864204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:52.864578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] PATH_INFO: `/v3/users/60b4aaa65b2a43ed8dc24707312e7657` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:52.866324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b4aaa65b2a43ed8dc24707312e7657)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:52.868572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:52.925533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b4aaa65b2a43ed8dc24707312e7657'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.945187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b4aaa65b2a43ed8dc24707312e7657'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.957365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b4aaa65b2a43ed8dc24707312e7657'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.958048 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b4aaa65b2a43ed8dc24707312e7657'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.971720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b4aaa65b2a43ed8dc24707312e7657'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:52.984074 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1136/2269] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:52 2022] DELETE /identity/v3/users/60b4aaa65b2a43ed8dc24707312e7657 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:53.123965 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.125744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:53.142218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9911d-46e1-48af-9e01-081da8ba1541 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.216187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.217447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.217727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.218036 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] PATH_INFO: `/v3/projects/fb2a0806ce2e4cc7bca3bc1d39dd493f` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.219337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2a0806ce2e4cc7bca3bc1d39dd493f)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.221301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.278775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2a0806ce2e4cc7bca3bc1d39dd493f', 'request_id': 'req-c054b7c2-40c9-49cc-8aa6-38d678714149'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.285070 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2a0806ce2e4cc7bca3bc1d39dd493f', 'request_id': 'req-c054b7c2-40c9-49cc-8aa6-38d678714149'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.293879 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2a0806ce2e4cc7bca3bc1d39dd493f', 'request_id': 'req-c054b7c2-40c9-49cc-8aa6-38d678714149'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.308420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.310400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] The token cache is being invalidate because project fb2a0806ce2e4cc7bca3bc1d39dd493f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:53.310902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.311401 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:53.312040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c054b7c2-40c9-49cc-8aa6-38d678714149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.319008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1134/2270] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:53 2022] DELETE /identity/v3/projects/fb2a0806ce2e4cc7bca3bc1d39dd493f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:53.321133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2244691-8385-4e5e-b516-8fe07897567f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.321496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2244691-8385-4e5e-b516-8fe07897567f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.321847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2244691-8385-4e5e-b516-8fe07897567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.334010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75302e-b7bb-428b-b858-45e237be87b0 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.351213 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b2244691-8385-4e5e-b516-8fe07897567f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:53.354305 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b2244691-8385-4e5e-b516-8fe07897567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:53.429597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.430480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.430761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.431112 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] PATH_INFO: `/v3/projects/983f0441473d4d268406d2e7e51c9410` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.432340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] RBAC: Authorizing `identity:delete_project(project_id=983f0441473d4d268406d2e7e51c9410)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.434372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.444298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1135/2271] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:53.449719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a36be5-0fae-49cd-becb-3803f239f4cc None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.449719 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a36be5-0fae-49cd-becb-3803f239f4cc None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.450181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a36be5-0fae-49cd-becb-3803f239f4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.485169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d0a36be5-0fae-49cd-becb-3803f239f4cc None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:53.486650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d0a36be5-0fae-49cd-becb-3803f239f4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:53.509198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983f0441473d4d268406d2e7e51c9410', 'request_id': 'req-462462e1-089f-4426-a49c-efa49b9b158e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.517674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983f0441473d4d268406d2e7e51c9410', 'request_id': 'req-462462e1-089f-4426-a49c-efa49b9b158e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.527759 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983f0441473d4d268406d2e7e51c9410', 'request_id': 'req-462462e1-089f-4426-a49c-efa49b9b158e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.540119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] The token cache is being invalidate because project 983f0441473d4d268406d2e7e51c9410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:53.540408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.541280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-462462e1-089f-4426-a49c-efa49b9b158e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:53.543423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1137/2272] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:53 2022] DELETE /identity/v3/projects/983f0441473d4d268406d2e7e51c9410 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:53.553005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cca75-d75c-4a22-b6c4-b288dad9f3e5 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.553594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cca75-d75c-4a22-b6c4-b288dad9f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.554026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cca75-d75c-4a22-b6c4-b288dad9f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.559072 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1136/2273] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:53.564480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a36be5-0fae-49cd-becb-3803f239f4cc None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.578188 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a36be5-0fae-49cd-becb-3803f239f4cc None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.582823 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-070cca75-d75c-4a22-b6c4-b288dad9f3e5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:53.585148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-070cca75-d75c-4a22-b6c4-b288dad9f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:53.592557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f6e72-2b28-494d-80e2-6a3026c3296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.593322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f6e72-2b28-494d-80e2-6a3026c3296f admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.593961 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f6e72-2b28-494d-80e2-6a3026c3296f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.595109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f6e72-2b28-494d-80e2-6a3026c3296f admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.596232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f6e72-2b28-494d-80e2-6a3026c3296f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:53.596471 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f6e72-2b28-494d-80e2-6a3026c3296f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.597064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1138/2274] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:53.598442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f6e72-2b28-494d-80e2-6a3026c3296f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.605528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7974b-bdfb-4304-bbf1-b4d579c38d12 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.605817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7974b-bdfb-4304-bbf1-b4d579c38d12 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.606294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7974b-bdfb-4304-bbf1-b4d579c38d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.618074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1137/2275] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 19:56:53.619296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f6e72-2b28-494d-80e2-6a3026c3296f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.627574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-50c7974b-bdfb-4304-bbf1-b4d579c38d12 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:53.628945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-50c7974b-bdfb-4304-bbf1-b4d579c38d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:53.632244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f6e72-2b28-494d-80e2-6a3026c3296f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.639386 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8371d4-0ccb-4474-a5ee-6aaadae43508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.639723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8371d4-0ccb-4474-a5ee-6aaadae43508 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.640098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8371d4-0ccb-4474-a5ee-6aaadae43508 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.640548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8371d4-0ccb-4474-a5ee-6aaadae43508 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.641347 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8371d4-0ccb-4474-a5ee-6aaadae43508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.643515 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8371d4-0ccb-4474-a5ee-6aaadae43508 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.647364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1139/2276] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:53.648468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7974b-bdfb-4304-bbf1-b4d579c38d12 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.658186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7974b-bdfb-4304-bbf1-b4d579c38d12 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.664023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defa059-fbb2-4889-b2ed-a9929fb5ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.664873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa059-fbb2-4889-b2ed-a9929fb5ada4 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.665149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa059-fbb2-4889-b2ed-a9929fb5ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.665411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa059-fbb2-4889-b2ed-a9929fb5ada4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.666330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defa059-fbb2-4889-b2ed-a9929fb5ada4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:53.666468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defa059-fbb2-4889-b2ed-a9929fb5ada4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.668453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defa059-fbb2-4889-b2ed-a9929fb5ada4 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.682192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1140/2277] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:53.682769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1138/2278] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:53 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:53.683648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defa059-fbb2-4889-b2ed-a9929fb5ada4 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.685096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8371d4-0ccb-4474-a5ee-6aaadae43508 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.694688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defa059-fbb2-4889-b2ed-a9929fb5ada4 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.783181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8371d4-0ccb-4474-a5ee-6aaadae43508 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.788383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f6fa-8edb-4661-b1c0-91337651f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.788773 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eeba2-4911-4e61-af84-01740147782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.789143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f6fa-8edb-4661-b1c0-91337651f784 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.789395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f6fa-8edb-4661-b1c0-91337651f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.789552 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eeba2-4911-4e61-af84-01740147782b admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.789658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f6fa-8edb-4661-b1c0-91337651f784 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.789745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eeba2-4911-4e61-af84-01740147782b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.790050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eeba2-4911-4e61-af84-01740147782b admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.790434 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f6fa-8edb-4661-b1c0-91337651f784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.790894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eeba2-4911-4e61-af84-01740147782b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.792329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f6fa-8edb-4661-b1c0-91337651f784 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.792847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4eeba2-4911-4e61-af84-01740147782b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.819764 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1141/2279] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:53 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:56:53.824560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eeba2-4911-4e61-af84-01740147782b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.826157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1139/2280] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:53 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:56:53.830244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f6fa-8edb-4661-b1c0-91337651f784 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.838619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4eeba2-4911-4e61-af84-01740147782b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.919356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f6fa-8edb-4661-b1c0-91337651f784 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.924369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cac5a-d1ad-4536-b57b-ed3e0424fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.925561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cac5a-d1ad-4536-b57b-ed3e0424fd84 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.925838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080e440-3cdf-40d8-a668-3367598a4f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.926017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cac5a-d1ad-4536-b57b-ed3e0424fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.926529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cac5a-d1ad-4536-b57b-ed3e0424fd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.927946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080e440-3cdf-40d8-a668-3367598a4f5f admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.928357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cac5a-d1ad-4536-b57b-ed3e0424fd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.928605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080e440-3cdf-40d8-a668-3367598a4f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.928895 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080e440-3cdf-40d8-a668-3367598a4f5f admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.929612 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080e440-3cdf-40d8-a668-3367598a4f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.930415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cac5a-d1ad-4536-b57b-ed3e0424fd84 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.931592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080e440-3cdf-40d8-a668-3367598a4f5f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.948097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1142/2281] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:53.949823 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cac5a-d1ad-4536-b57b-ed3e0424fd84 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.966263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1140/2282] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:53 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 19:56:53.969203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cac5a-d1ad-4536-b57b-ed3e0424fd84 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.972529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080e440-3cdf-40d8-a668-3367598a4f5f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:53.985711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6292-1489-42c9-b16f-4453cf418724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.987045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6292-1489-42c9-b16f-4453cf418724 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:53.987625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6292-1489-42c9-b16f-4453cf418724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:53.988225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6292-1489-42c9-b16f-4453cf418724 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:53.989618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080e440-3cdf-40d8-a668-3367598a4f5f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:53.989882 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6292-1489-42c9-b16f-4453cf418724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:53.993158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6292-1489-42c9-b16f-4453cf418724 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:53.998393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125acc-43f2-49d0-8b9a-d617fc1534a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:53.999730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125acc-43f2-49d0-8b9a-d617fc1534a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.000237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125acc-43f2-49d0-8b9a-d617fc1534a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.000727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125acc-43f2-49d0-8b9a-d617fc1534a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.002159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8125acc-43f2-49d0-8b9a-d617fc1534a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:54.004742 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8125acc-43f2-49d0-8b9a-d617fc1534a3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:54.016322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1143/2283] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:54.020503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6292-1489-42c9-b16f-4453cf418724 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:54.022736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1141/2284] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:54.027206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125acc-43f2-49d0-8b9a-d617fc1534a3 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:54.036836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6292-1489-42c9-b16f-4453cf418724 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:54.041995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125acc-43f2-49d0-8b9a-d617fc1534a3 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:54.043440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5a37-3e25-4701-843a-50897222b942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:54.044543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5a37-3e25-4701-843a-50897222b942 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.045017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5a37-3e25-4701-843a-50897222b942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.045324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5a37-3e25-4701-843a-50897222b942 admin admin] PATH_INFO: `/v3/projects/33e6e468d6ef4001bd443c6da27856af/users/d06000c4e187474683a1f6422442d485/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.047623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca069636-1a82-4ef3-abb3-52c5973ecd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:54.048426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca069636-1a82-4ef3-abb3-52c5973ecd30 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.048837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca069636-1a82-4ef3-abb3-52c5973ecd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.049234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca069636-1a82-4ef3-abb3-52c5973ecd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.050276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca069636-1a82-4ef3-abb3-52c5973ecd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:54.052237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca069636-1a82-4ef3-abb3-52c5973ecd30 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:54.061956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b5a37-3e25-4701-843a-50897222b942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e6e468d6ef4001bd443c6da27856af, user_id=d06000c4e187474683a1f6422442d485, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:54.064690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b5a37-3e25-4701-843a-50897222b942 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:54.068649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1142/2285] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:54.073484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca069636-1a82-4ef3-abb3-52c5973ecd30 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:54.085067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca069636-1a82-4ef3-abb3-52c5973ecd30 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:54.095679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1144/2286] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:54 2022] PUT /identity/v3/projects/33e6e468d6ef4001bd443c6da27856af/users/d06000c4e187474683a1f6422442d485/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:54.117129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bad3d-6969-4968-9db2-1416455fcbc9 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.117302 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bad3d-6969-4968-9db2-1416455fcbc9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.117572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bad3d-6969-4968-9db2-1416455fcbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.150994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d13bad3d-6969-4968-9db2-1416455fcbc9 None None] MFA Rules not processed for user `d06000c4e187474683a1f6422442d485`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:54.152695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d13bad3d-6969-4968-9db2-1416455fcbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:54.168430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc898f-fc74-45cf-bb4b-25ca76f8151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:54.169912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc898f-fc74-45cf-bb4b-25ca76f8151c admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.170428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc898f-fc74-45cf-bb4b-25ca76f8151c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.170887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc898f-fc74-45cf-bb4b-25ca76f8151c admin admin] PATH_INFO: `/v3/projects/4f57dcb686a7460da817bc96d9bb600a/users/ba760371689642caa44693a9944d0462/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.190290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc898f-fc74-45cf-bb4b-25ca76f8151c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f57dcb686a7460da817bc96d9bb600a, user_id=ba760371689642caa44693a9944d0462, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:54.193255 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc898f-fc74-45cf-bb4b-25ca76f8151c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:54.212761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1143/2287] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:54 2022] PUT /identity/v3/projects/4f57dcb686a7460da817bc96d9bb600a/users/ba760371689642caa44693a9944d0462/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:54.226289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b315ce1-a8a5-4407-ae17-d8b7ce82c5a0 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.226691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b315ce1-a8a5-4407-ae17-d8b7ce82c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.227039 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b315ce1-a8a5-4407-ae17-d8b7ce82c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.248224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1145/2288] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:54.257470 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-7b315ce1-a8a5-4407-ae17-d8b7ce82c5a0 None None] MFA Rules not processed for user `ba760371689642caa44693a9944d0462`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:54.258761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7b315ce1-a8a5-4407-ae17-d8b7ce82c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:54.271026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bad3d-6969-4968-9db2-1416455fcbc9 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:54.272516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d13bad3d-6969-4968-9db2-1416455fcbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:54.348139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bad3d-6969-4968-9db2-1416455fcbc9 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:54.353314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1144/2289] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:54.369754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b315ce1-a8a5-4407-ae17-d8b7ce82c5a0 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:54.370278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7b315ce1-a8a5-4407-ae17-d8b7ce82c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:54.406040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e70472-3314-44a5-9561-131c7d5dd4a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:54.406743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e70472-3314-44a5-9561-131c7d5dd4a3 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.407150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e70472-3314-44a5-9561-131c7d5dd4a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.407506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e70472-3314-44a5-9561-131c7d5dd4a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.449986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b315ce1-a8a5-4407-ae17-d8b7ce82c5a0 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:54.456070 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929de0ba-dd48-47e7-a67a-112d583781cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:54.457381 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de0ba-dd48-47e7-a67a-112d583781cc service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.457676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de0ba-dd48-47e7-a67a-112d583781cc service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.458296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de0ba-dd48-47e7-a67a-112d583781cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.471052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929de0ba-dd48-47e7-a67a-112d583781cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:54.472518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929de0ba-dd48-47e7-a67a-112d583781cc service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:54.483077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1145/2290] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:56:54.493009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e70472-3314-44a5-9561-131c7d5dd4a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:54.494527 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e70472-3314-44a5-9561-131c7d5dd4a3 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:54.510698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1146/2291] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:54.522650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929de0ba-dd48-47e7-a67a-112d583781cc service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:54.626488 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929de0ba-dd48-47e7-a67a-112d583781cc service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:54.634299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:54.637913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.638269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.638561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] PATH_INFO: `/v3/users/ba760371689642caa44693a9944d0462` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.639956 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba760371689642caa44693a9944d0462)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:54.642014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:54.703841 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba760371689642caa44693a9944d0462'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:54.704914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba760371689642caa44693a9944d0462'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:54.705768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba760371689642caa44693a9944d0462'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:54.717907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba760371689642caa44693a9944d0462'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:54.729678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba760371689642caa44693a9944d0462'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:54.753864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1146/2292] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:54 2022] DELETE /identity/v3/users/ba760371689642caa44693a9944d0462 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:54.758411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e731136-c89c-403b-9a44-12de9811df6b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.759004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e731136-c89c-403b-9a44-12de9811df6b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.759150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e731136-c89c-403b-9a44-12de9811df6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.782690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4e731136-c89c-403b-9a44-12de9811df6b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:54.784498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4e731136-c89c-403b-9a44-12de9811df6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:54.886211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1147/2293] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:54.897468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:54.899286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:54.969616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ec569-2bd8-4e1f-b3c6-d05263f7f24f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:54.973979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c6329-4ea6-4aa4-94ad-e1c288b38d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:54.975628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c6329-4ea6-4aa4-94ad-e1c288b38d5e service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:54.975954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c6329-4ea6-4aa4-94ad-e1c288b38d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:54.976283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c6329-4ea6-4aa4-94ad-e1c288b38d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:54.987280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c6329-4ea6-4aa4-94ad-e1c288b38d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:54.988748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c6329-4ea6-4aa4-94ad-e1c288b38d5e service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:55.000133 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1147/2294] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:55.334321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e731136-c89c-403b-9a44-12de9811df6b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:55.335932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4e731136-c89c-403b-9a44-12de9811df6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:55.351471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e731136-c89c-403b-9a44-12de9811df6b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:55.357283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:55.359771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:55.360117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:55.360457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] PATH_INFO: `/v3/projects/4f57dcb686a7460da817bc96d9bb600a` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:55.362261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f57dcb686a7460da817bc96d9bb600a)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:55.364721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:55.413488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f57dcb686a7460da817bc96d9bb600a', 'request_id': 'req-ddbae941-026d-4b56-a22e-4baa2da6af80'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:55.418923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f57dcb686a7460da817bc96d9bb600a', 'request_id': 'req-ddbae941-026d-4b56-a22e-4baa2da6af80'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:55.426552 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f57dcb686a7460da817bc96d9bb600a', 'request_id': 'req-ddbae941-026d-4b56-a22e-4baa2da6af80'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:55.438947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] The token cache is being invalidate because project 4f57dcb686a7460da817bc96d9bb600a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:55.439258 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:55.439899 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddbae941-026d-4b56-a22e-4baa2da6af80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:55.441603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1148/2295] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:55 2022] DELETE /identity/v3/projects/4f57dcb686a7460da817bc96d9bb600a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:55.447298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53445-704c-4255-bfdc-864e4962314e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:55.447864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53445-704c-4255-bfdc-864e4962314e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:55.447864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53445-704c-4255-bfdc-864e4962314e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:55.468422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-f0d53445-704c-4255-bfdc-864e4962314e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:55.469530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f0d53445-704c-4255-bfdc-864e4962314e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:55.544150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1148/2296] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 19:56:55.552246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4115-48f5-4512-9f41-b8f1c93edc14 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:55.553190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4115-48f5-4512-9f41-b8f1c93edc14 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:55.553507 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4115-48f5-4512-9f41-b8f1c93edc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:55.580821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-0c1f4115-48f5-4512-9f41-b8f1c93edc14 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:55.582229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0c1f4115-48f5-4512-9f41-b8f1c93edc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:55.592609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1149/2297] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:55.596894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53445-704c-4255-bfdc-864e4962314e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:55.608130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53445-704c-4255-bfdc-864e4962314e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:55.614216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0862151-a1e4-4516-b7ed-2c77fbc74797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:55.615728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862151-a1e4-4516-b7ed-2c77fbc74797 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:55.615728 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862151-a1e4-4516-b7ed-2c77fbc74797 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:55.616055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862151-a1e4-4516-b7ed-2c77fbc74797 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:55.616786 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0862151-a1e4-4516-b7ed-2c77fbc74797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:55.617098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0862151-a1e4-4516-b7ed-2c77fbc74797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:55.626560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0862151-a1e4-4516-b7ed-2c77fbc74797 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:55.643261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1149/2298] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:55.644992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4115-48f5-4512-9f41-b8f1c93edc14 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:55.660361 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4115-48f5-4512-9f41-b8f1c93edc14 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:55.668172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd3431-63cc-4d16-8684-f11ff64710db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:55.668963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd3431-63cc-4d16-8684-f11ff64710db admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:55.669290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd3431-63cc-4d16-8684-f11ff64710db admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:55.669635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd3431-63cc-4d16-8684-f11ff64710db admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:55.670457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd3431-63cc-4d16-8684-f11ff64710db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:55.673124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd3431-63cc-4d16-8684-f11ff64710db admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:55.719640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1150/2299] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:55 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:55.721410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0862151-a1e4-4516-b7ed-2c77fbc74797 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:55.735245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0862151-a1e4-4516-b7ed-2c77fbc74797 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:55.816520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125db04-4883-4bc8-b4c7-b1df8f6c73ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:55.817208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125db04-4883-4bc8-b4c7-b1df8f6c73ff admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:55.817484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125db04-4883-4bc8-b4c7-b1df8f6c73ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:55.817756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125db04-4883-4bc8-b4c7-b1df8f6c73ff admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:55.819155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125db04-4883-4bc8-b4c7-b1df8f6c73ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:55.821108 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125db04-4883-4bc8-b4c7-b1df8f6c73ff admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:55.850456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1150/2300] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:55 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:55.855947 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd3431-63cc-4d16-8684-f11ff64710db admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:55.868576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd3431-63cc-4d16-8684-f11ff64710db admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:55.874233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d7dee-978f-42fb-99f9-5d723b967f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:55.874945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d7dee-978f-42fb-99f9-5d723b967f89 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:55.875221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d7dee-978f-42fb-99f9-5d723b967f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:55.875488 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d7dee-978f-42fb-99f9-5d723b967f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:55.876279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d7dee-978f-42fb-99f9-5d723b967f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:55.880117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d7dee-978f-42fb-99f9-5d723b967f89 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:55.894729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1151/2301] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:55.904537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125db04-4883-4bc8-b4c7-b1df8f6c73ff admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:55.916416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125db04-4883-4bc8-b4c7-b1df8f6c73ff admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:55.924181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96717842-3540-4f97-89d6-16eb479c59fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:55.925250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96717842-3540-4f97-89d6-16eb479c59fa admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:55.925788 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96717842-3540-4f97-89d6-16eb479c59fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:55.926286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96717842-3540-4f97-89d6-16eb479c59fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:55.927537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96717842-3540-4f97-89d6-16eb479c59fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:55.930464 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96717842-3540-4f97-89d6-16eb479c59fa admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:55.943796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1151/2302] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:55.948385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d7dee-978f-42fb-99f9-5d723b967f89 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:55.961565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d7dee-978f-42fb-99f9-5d723b967f89 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:55.984344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e8bb5-5645-47ed-bce3-76e65dd42747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:55.985479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e8bb5-5645-47ed-bce3-76e65dd42747 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:55.985928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e8bb5-5645-47ed-bce3-76e65dd42747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:55.986473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e8bb5-5645-47ed-bce3-76e65dd42747 admin admin] PATH_INFO: `/v3/projects/1f686666a9de46c18bb528e7bc87b034/users/26c482edd8e24f53b796fd3ccadd3b27/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:56.003968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e8bb5-5645-47ed-bce3-76e65dd42747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f686666a9de46c18bb528e7bc87b034, user_id=26c482edd8e24f53b796fd3ccadd3b27, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:56.006786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e8bb5-5645-47ed-bce3-76e65dd42747 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:56.024701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1152/2303] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:55 2022] PUT /identity/v3/projects/1f686666a9de46c18bb528e7bc87b034/users/26c482edd8e24f53b796fd3ccadd3b27/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:56.035729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f672e9-0f0c-4011-bd4d-af637819a391 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:56.036102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f672e9-0f0c-4011-bd4d-af637819a391 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:56.036995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f672e9-0f0c-4011-bd4d-af637819a391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:56.076771 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-b9f672e9-0f0c-4011-bd4d-af637819a391 None None] MFA Rules not processed for user `26c482edd8e24f53b796fd3ccadd3b27`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:56.078076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b9f672e9-0f0c-4011-bd4d-af637819a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:56.202896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1152/2304] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:56.214263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e8bb5-5645-47ed-bce3-76e65dd42747 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:56.216029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-400e8bb5-5645-47ed-bce3-76e65dd42747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:56.298968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e8bb5-5645-47ed-bce3-76e65dd42747 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:56.303805 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a3ad-6911-4925-9517-5835f3522616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:56.304455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a3ad-6911-4925-9517-5835f3522616 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:56.304881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a3ad-6911-4925-9517-5835f3522616 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:56.305165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a3ad-6911-4925-9517-5835f3522616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:56.316042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a3ad-6911-4925-9517-5835f3522616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:56.317629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a3ad-6911-4925-9517-5835f3522616 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:56.333082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1153/2305] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:57.221710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f672e9-0f0c-4011-bd4d-af637819a391 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:57.223231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b9f672e9-0f0c-4011-bd4d-af637819a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:57.324574 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f672e9-0f0c-4011-bd4d-af637819a391 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:57.335281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:57.336264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:57.336608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:57.336973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] PATH_INFO: `/v3/users/d06000c4e187474683a1f6422442d485` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:57.338755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06000c4e187474683a1f6422442d485)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:57.341053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:57.423006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06000c4e187474683a1f6422442d485'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:57.423526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06000c4e187474683a1f6422442d485'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:57.424421 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06000c4e187474683a1f6422442d485'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:57.434398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06000c4e187474683a1f6422442d485'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:57.445922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06000c4e187474683a1f6422442d485'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:57.482138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1153/2306] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:56:57 2022] DELETE /identity/v3/users/d06000c4e187474683a1f6422442d485 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:57.486980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36b78-77eb-42de-a462-52684dd4b762 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:57.487675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36b78-77eb-42de-a462-52684dd4b762 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:57.487675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36b78-77eb-42de-a462-52684dd4b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:57.515341 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-f5b36b78-77eb-42de-a462-52684dd4b762 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:57.517693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f5b36b78-77eb-42de-a462-52684dd4b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:57.637992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1154/2307] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:57.649605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:57.652121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:57.732348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c19f9e-39a6-4ce6-918d-4001d4928894 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:57.743933 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8019b-61c3-4dda-99be-6d99f5deafae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:57.744783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8019b-61c3-4dda-99be-6d99f5deafae service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:57.745083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8019b-61c3-4dda-99be-6d99f5deafae service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:57.745477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8019b-61c3-4dda-99be-6d99f5deafae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:57.768613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8019b-61c3-4dda-99be-6d99f5deafae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:57.772227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8019b-61c3-4dda-99be-6d99f5deafae service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:57.786788 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1154/2308] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:56:58.231524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b36b78-77eb-42de-a462-52684dd4b762 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:58.233971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f5b36b78-77eb-42de-a462-52684dd4b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:58.265264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b36b78-77eb-42de-a462-52684dd4b762 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:58.304145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:58.306042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:58.308371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:58.311391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] PATH_INFO: `/v3/projects/33e6e468d6ef4001bd443c6da27856af` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:58.324245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e6e468d6ef4001bd443c6da27856af)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:58.332669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:58.434187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e6e468d6ef4001bd443c6da27856af', 'request_id': 'req-df4bbeeb-ffce-4727-8d25-4357f3584440'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:58.441591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e6e468d6ef4001bd443c6da27856af', 'request_id': 'req-df4bbeeb-ffce-4727-8d25-4357f3584440'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:58.452253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e6e468d6ef4001bd443c6da27856af', 'request_id': 'req-df4bbeeb-ffce-4727-8d25-4357f3584440'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:58.481454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] The token cache is being invalidate because project 33e6e468d6ef4001bd443c6da27856af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:56:58.481754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:58.484585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-df4bbeeb-ffce-4727-8d25-4357f3584440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:56:58.486968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1155/2309] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:56:58 2022] DELETE /identity/v3/projects/33e6e468d6ef4001bd443c6da27856af => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:56:58.492403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70a326-9d47-4144-a121-413a4c307c51 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:58.493501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70a326-9d47-4144-a121-413a4c307c51 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:58.494005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70a326-9d47-4144-a121-413a4c307c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:58.519431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1d70a326-9d47-4144-a121-413a4c307c51 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:58.523029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1d70a326-9d47-4144-a121-413a4c307c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:58.625263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1155/2310] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:58.636694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297dd2b-82c5-4876-892c-16b4e12e52e8 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:58.637584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297dd2b-82c5-4876-892c-16b4e12e52e8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:58.638447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297dd2b-82c5-4876-892c-16b4e12e52e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:58.673077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-6297dd2b-82c5-4876-892c-16b4e12e52e8 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:58.674462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6297dd2b-82c5-4876-892c-16b4e12e52e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:58.684710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1156/2311] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:58.688830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70a326-9d47-4144-a121-413a4c307c51 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:58.701581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70a326-9d47-4144-a121-413a4c307c51 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:58.707613 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9455fa-31b6-4a7f-8c06-6444c26eed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:58.708666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9455fa-31b6-4a7f-8c06-6444c26eed09 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:58.709130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9455fa-31b6-4a7f-8c06-6444c26eed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:58.709612 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9455fa-31b6-4a7f-8c06-6444c26eed09 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:58.710600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9455fa-31b6-4a7f-8c06-6444c26eed09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 19:56:58.711121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9455fa-31b6-4a7f-8c06-6444c26eed09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:58.712949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9455fa-31b6-4a7f-8c06-6444c26eed09 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:58.726569 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1156/2312] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 19:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 19:56:58.731459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297dd2b-82c5-4876-892c-16b4e12e52e8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:58.742653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297dd2b-82c5-4876-892c-16b4e12e52e8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:58.747872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cd773-4139-4b34-8a81-f50a5da7feeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:58.748864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cd773-4139-4b34-8a81-f50a5da7feeb admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:58.749324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cd773-4139-4b34-8a81-f50a5da7feeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:58.749774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cd773-4139-4b34-8a81-f50a5da7feeb admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:58.750758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cd773-4139-4b34-8a81-f50a5da7feeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:58.753023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cd773-4139-4b34-8a81-f50a5da7feeb admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:58.783974 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1157/2313] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 19:56:58 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:58.788306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9455fa-31b6-4a7f-8c06-6444c26eed09 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:58.800102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9455fa-31b6-4a7f-8c06-6444c26eed09 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:58.905651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67706f5-3cbe-4cfe-b6d5-031e81aaad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:58.906380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67706f5-3cbe-4cfe-b6d5-031e81aaad5a admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:58.906664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67706f5-3cbe-4cfe-b6d5-031e81aaad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:58.906942 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67706f5-3cbe-4cfe-b6d5-031e81aaad5a admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:58.907656 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67706f5-3cbe-4cfe-b6d5-031e81aaad5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:58.909685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67706f5-3cbe-4cfe-b6d5-031e81aaad5a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:58.932766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1157/2314] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 19:56:58 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 19:56:58.937040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cd773-4139-4b34-8a81-f50a5da7feeb admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:58.948981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cd773-4139-4b34-8a81-f50a5da7feeb admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:58.953753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8518e-1a6e-401f-8bdb-32b034f0fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:58.954507 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8518e-1a6e-401f-8bdb-32b034f0fa69 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:58.955001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8518e-1a6e-401f-8bdb-32b034f0fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:58.955295 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8518e-1a6e-401f-8bdb-32b034f0fa69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:58.955998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8518e-1a6e-401f-8bdb-32b034f0fa69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:58.957610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8518e-1a6e-401f-8bdb-32b034f0fa69 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:58.973109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1158/2315] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 19:56:58.974109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67706f5-3cbe-4cfe-b6d5-031e81aaad5a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:58.985219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67706f5-3cbe-4cfe-b6d5-031e81aaad5a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:58.991365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043838-a782-4e96-afc6-fff99e1f8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:58.992052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043838-a782-4e96-afc6-fff99e1f8f6b admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:58.992330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043838-a782-4e96-afc6-fff99e1f8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:58.992606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043838-a782-4e96-afc6-fff99e1f8f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:58.993334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8043838-a782-4e96-afc6-fff99e1f8f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:58.994983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8043838-a782-4e96-afc6-fff99e1f8f6b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:59.007142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1158/2316] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 19:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 19:56:59.011464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8518e-1a6e-401f-8bdb-32b034f0fa69 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:59.024223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8518e-1a6e-401f-8bdb-32b034f0fa69 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:59.029120 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f24a75-70e2-4cf5-8995-d29f4fe9b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:59.030040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f24a75-70e2-4cf5-8995-d29f4fe9b8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:59.030356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f24a75-70e2-4cf5-8995-d29f4fe9b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:59.030658 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f24a75-70e2-4cf5-8995-d29f4fe9b8e0 admin admin] PATH_INFO: `/v3/projects/65348cbf3b5d4178a385b1c1031b5ff6/users/707de543471349dcb40e1f374a14baed/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:59.046690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f24a75-70e2-4cf5-8995-d29f4fe9b8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65348cbf3b5d4178a385b1c1031b5ff6, user_id=707de543471349dcb40e1f374a14baed, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:59.049416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f24a75-70e2-4cf5-8995-d29f4fe9b8e0 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:59.064738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1159/2317] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 19:56:59 2022] PUT /identity/v3/projects/65348cbf3b5d4178a385b1c1031b5ff6/users/707de543471349dcb40e1f374a14baed/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 19:56:59.070698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e71dc4-f0b2-496c-9651-7ec3335d0962 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:59.070993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e71dc4-f0b2-496c-9651-7ec3335d0962 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:59.071273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e71dc4-f0b2-496c-9651-7ec3335d0962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:59.093717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-42e71dc4-f0b2-496c-9651-7ec3335d0962 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:56:59.094984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-42e71dc4-f0b2-496c-9651-7ec3335d0962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:59.173766 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1159/2318] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:56:59.183566 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f24a75-70e2-4cf5-8995-d29f4fe9b8e0 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:56:59.185322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-66f24a75-70e2-4cf5-8995-d29f4fe9b8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:56:59.399992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f24a75-70e2-4cf5-8995-d29f4fe9b8e0 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:56:59.403885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf74ff-3c41-4f79-821d-ac0e569a89c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:56:59.404540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf74ff-3c41-4f79-821d-ac0e569a89c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:56:59.404866 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf74ff-3c41-4f79-821d-ac0e569a89c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:56:59.405076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf74ff-3c41-4f79-821d-ac0e569a89c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:56:59.418395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf74ff-3c41-4f79-821d-ac0e569a89c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:56:59.419868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf74ff-3c41-4f79-821d-ac0e569a89c7 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:56:59.433061 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1160/2319] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:57:00.236016 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f04f7-eabc-4254-b2e9-f43b950db5cd None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:57:00.236867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f04f7-eabc-4254-b2e9-f43b950db5cd None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:57:00.237231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f04f7-eabc-4254-b2e9-f43b950db5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:57:00.281313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-cf8f04f7-eabc-4254-b2e9-f43b950db5cd None None] MFA Rules not processed for user `707de543471349dcb40e1f374a14baed`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:57:00.283637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-cf8f04f7-eabc-4254-b2e9-f43b950db5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:57:00.523022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1160/2320] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:57:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:57:00.535284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf74ff-3c41-4f79-821d-ac0e569a89c7 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:57:00.538257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-afcf74ff-3c41-4f79-821d-ac0e569a89c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:57:00.613484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf74ff-3c41-4f79-821d-ac0e569a89c7 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:57:00.617476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e4ea3-8d6e-40e2-9ebd-5b187844fbe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:57:00.618277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e4ea3-8d6e-40e2-9ebd-5b187844fbe5 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:57:00.618660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e4ea3-8d6e-40e2-9ebd-5b187844fbe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:57:00.619044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e4ea3-8d6e-40e2-9ebd-5b187844fbe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:57:00.629511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e4ea3-8d6e-40e2-9ebd-5b187844fbe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:57:00.631815 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e4ea3-8d6e-40e2-9ebd-5b187844fbe5 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:57:00.642375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1161/2321] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:57:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:57:03.139056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb959-cf52-41e9-b7b6-6e0c2da7dd18 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:57:03.139609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb959-cf52-41e9-b7b6-6e0c2da7dd18 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:57:03.139609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb959-cf52-41e9-b7b6-6e0c2da7dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:57:03.157810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c0abb959-cf52-41e9-b7b6-6e0c2da7dd18 None None] MFA Rules not processed for user `707de543471349dcb40e1f374a14baed`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:57:03.159053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c0abb959-cf52-41e9-b7b6-6e0c2da7dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:57:03.183484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1161/2322] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:57:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:57:08.172205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e4ea3-8d6e-40e2-9ebd-5b187844fbe5 service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:57:08.173761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-249e4ea3-8d6e-40e2-9ebd-5b187844fbe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:57:08.192455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e4ea3-8d6e-40e2-9ebd-5b187844fbe5 service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:57:08.197703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:57:08.198751 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:57:08.199140 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:57:08.199512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] PATH_INFO: `/v3/users/26c482edd8e24f53b796fd3ccadd3b27` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:57:08.200980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c482edd8e24f53b796fd3ccadd3b27)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:57:08.203332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:57:08.278415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c482edd8e24f53b796fd3ccadd3b27'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:08.300318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c482edd8e24f53b796fd3ccadd3b27'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:08.309710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c482edd8e24f53b796fd3ccadd3b27'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:08.310379 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c482edd8e24f53b796fd3ccadd3b27'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:08.318135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c482edd8e24f53b796fd3ccadd3b27'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:08.324520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1162/2323] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 19:57:08 2022] DELETE /identity/v3/users/26c482edd8e24f53b796fd3ccadd3b27 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:57:08.330388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c80872-24f1-4d88-a82d-a5e0459d6eaf None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:57:08.330944 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c80872-24f1-4d88-a82d-a5e0459d6eaf None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:57:08.331504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c80872-24f1-4d88-a82d-a5e0459d6eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:57:08.360874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-92c80872-24f1-4d88-a82d-a5e0459d6eaf None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:57:08.363098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-92c80872-24f1-4d88-a82d-a5e0459d6eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:57:08.462381 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1162/2324] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:57:08.475509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:57:08.477307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:57:08.544700 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ae0e-3315-4399-820f-ce464fae79ee admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:57:08.553746 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef919c9-db80-49ca-a2c6-f7dce4f4a7a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:57:08.554495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef919c9-db80-49ca-a2c6-f7dce4f4a7a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:57:08.554813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef919c9-db80-49ca-a2c6-f7dce4f4a7a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:57:08.555087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef919c9-db80-49ca-a2c6-f7dce4f4a7a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:57:08.565761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef919c9-db80-49ca-a2c6-f7dce4f4a7a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:57:08.567260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef919c9-db80-49ca-a2c6-f7dce4f4a7a2 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:57:08.578179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1163/2325] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:57:08.992715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c80872-24f1-4d88-a82d-a5e0459d6eaf None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:57:08.994565 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-92c80872-24f1-4d88-a82d-a5e0459d6eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:57:09.010582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c80872-24f1-4d88-a82d-a5e0459d6eaf None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:57:09.015924 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:57:09.016952 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:57:09.017231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:57:09.017500 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] PATH_INFO: `/v3/projects/1f686666a9de46c18bb528e7bc87b034` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:57:09.018914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f686666a9de46c18bb528e7bc87b034)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:57:09.021708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:57:09.073519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f686666a9de46c18bb528e7bc87b034', 'request_id': 'req-54f2de7d-b70d-419e-8a29-5271ce8fa112'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:09.078856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f686666a9de46c18bb528e7bc87b034', 'request_id': 'req-54f2de7d-b70d-419e-8a29-5271ce8fa112'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:09.086446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f686666a9de46c18bb528e7bc87b034', 'request_id': 'req-54f2de7d-b70d-419e-8a29-5271ce8fa112'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:09.102905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] The token cache is being invalidate because project 1f686666a9de46c18bb528e7bc87b034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 19:57:09.103189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:09.103832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-54f2de7d-b70d-419e-8a29-5271ce8fa112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 19:57:09.105377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1163/2326] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 19:57:08 2022] DELETE /identity/v3/projects/1f686666a9de46c18bb528e7bc87b034 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 19:57:15.884631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef919c9-db80-49ca-a2c6-f7dce4f4a7a2 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:57:15.886346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fef919c9-db80-49ca-a2c6-f7dce4f4a7a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:57:15.902430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef919c9-db80-49ca-a2c6-f7dce4f4a7a2 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:57:15.984355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c66bb9-8040-4c7d-a94d-70eeaa7d0ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:57:15.986014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c66bb9-8040-4c7d-a94d-70eeaa7d0ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:57:15.986489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c66bb9-8040-4c7d-a94d-70eeaa7d0ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:57:15.988410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c66bb9-8040-4c7d-a94d-70eeaa7d0ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:57:15.992267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-66c66bb9-8040-4c7d-a94d-70eeaa7d0ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:57:16.088859 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c66bb9-8040-4c7d-a94d-70eeaa7d0ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:57:16.091042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c66bb9-8040-4c7d-a94d-70eeaa7d0ca5 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:57:16.103490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1164/2327] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:57:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:58:00.456413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cd386-33bc-484f-bd8f-b5e6b2d8e387 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:58:00.457154 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cd386-33bc-484f-bd8f-b5e6b2d8e387 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:58:00.457154 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cd386-33bc-484f-bd8f-b5e6b2d8e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:58:00.477422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-779cd386-33bc-484f-bd8f-b5e6b2d8e387 None None] MFA Rules not processed for user `9680269cd8504c36b6027040e185a817`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:58:00.479023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-779cd386-33bc-484f-bd8f-b5e6b2d8e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:58:00.542305 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1164/2328] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:58:50.863362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500b36-953e-42c9-a343-ea0c149a039b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:58:50.864619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500b36-953e-42c9-a343-ea0c149a039b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:58:50.864847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500b36-953e-42c9-a343-ea0c149a039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:58:50.892630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-27500b36-953e-42c9-a343-ea0c149a039b None None] MFA Rules not processed for user `707de543471349dcb40e1f374a14baed`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:58:50.893926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-27500b36-953e-42c9-a343-ea0c149a039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:58:50.954380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1165/2329] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 19:58:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:58:50.991836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cd386-33bc-484f-bd8f-b5e6b2d8e387 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:58:50.993507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-779cd386-33bc-484f-bd8f-b5e6b2d8e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:58:51.075701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cd386-33bc-484f-bd8f-b5e6b2d8e387 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:58:51.079619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:58:51.080220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:58:51.080501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:58:51.080826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:58:51.082936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:58:51.172001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:58:51.173501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:58:51.197604 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1165/2330] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:58:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:58:51.754944 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500b36-953e-42c9-a343-ea0c149a039b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:58:51.756449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-27500b36-953e-42c9-a343-ea0c149a039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:58:51.758503 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:58:51.760078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:58:51.771860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa678e-2240-44d9-af24-fa674a3cd1ae service glance] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:58:51.775643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790bbae-b317-42a2-8394-13c213093f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:58:51.776518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790bbae-b317-42a2-8394-13c213093f65 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:58:51.776894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790bbae-b317-42a2-8394-13c213093f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:58:51.777205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790bbae-b317-42a2-8394-13c213093f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:58:51.779089 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1790bbae-b317-42a2-8394-13c213093f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:58:51.796696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790bbae-b317-42a2-8394-13c213093f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:58:51.798358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790bbae-b317-42a2-8394-13c213093f65 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:58:51.811137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1166/2331] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:58:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:58:51.836543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500b36-953e-42c9-a343-ea0c149a039b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:58:51.842666 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05b667-9678-4457-ae95-e68b3b1555cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:58:51.843332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05b667-9678-4457-ae95-e68b3b1555cf service placement] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:58:51.843615 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05b667-9678-4457-ae95-e68b3b1555cf service placement] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:58:51.843892 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05b667-9678-4457-ae95-e68b3b1555cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:58:51.846173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1f05b667-9678-4457-ae95-e68b3b1555cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:58:51.858962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05b667-9678-4457-ae95-e68b3b1555cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:58:51.860742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05b667-9678-4457-ae95-e68b3b1555cf service placement] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:58:51.871954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1166/2332] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:58:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:59:04.089079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790bbae-b317-42a2-8394-13c213093f65 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:59:04.103258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790bbae-b317-42a2-8394-13c213093f65 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:59:04.109100 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:59:04.109747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:04.110051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:04.110327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:04.112388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:04.123928 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:59:04.125406 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:59:04.139034 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1167/2333] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:59:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:59:31.629879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9934e3-d7e2-4a52-979d-2e2a0a4a7883 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:31.630502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9934e3-d7e2-4a52-979d-2e2a0a4a7883 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:31.630603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9934e3-d7e2-4a52-979d-2e2a0a4a7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:31.705496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-ea9934e3-d7e2-4a52-979d-2e2a0a4a7883 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:59:31.706794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ea9934e3-d7e2-4a52-979d-2e2a0a4a7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:31.805329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1167/2334] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 19:59:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:59:31.867882 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:59:31.869398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:31.978459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ee0f1-766d-4b49-b784-18ead0b753ba service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:59:31.989824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde2984-ac0a-4011-9699-c2f8e292fcf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:59:31.990921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2984-ac0a-4011-9699-c2f8e292fcf7 service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:31.991338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2984-ac0a-4011-9699-c2f8e292fcf7 service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:31.991844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2984-ac0a-4011-9699-c2f8e292fcf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:32.004168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde2984-ac0a-4011-9699-c2f8e292fcf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:59:32.005322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde2984-ac0a-4011-9699-c2f8e292fcf7 service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:59:32.015166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1168/2335] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 19:59:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 19:59:41.208220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9934e3-d7e2-4a52-979d-2e2a0a4a7883 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:59:41.210780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ea9934e3-d7e2-4a52-979d-2e2a0a4a7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:41.247187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9934e3-d7e2-4a52-979d-2e2a0a4a7883 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:59:41.255481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffee28-8e3a-4452-85d8-86c3ec1e6ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:59:41.256647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffee28-8e3a-4452-85d8-86c3ec1e6ec8 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:41.257219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffee28-8e3a-4452-85d8-86c3ec1e6ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:41.257766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffee28-8e3a-4452-85d8-86c3ec1e6ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:41.261732 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c4ffee28-8e3a-4452-85d8-86c3ec1e6ec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:41.277518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffee28-8e3a-4452-85d8-86c3ec1e6ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:59:41.279725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffee28-8e3a-4452-85d8-86c3ec1e6ec8 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:59:41.292650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1168/2336] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:59:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 19:59:54.108893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde2984-ac0a-4011-9699-c2f8e292fcf7 service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:59:54.110798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2dde2984-ac0a-4011-9699-c2f8e292fcf7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:54.129664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde2984-ac0a-4011-9699-c2f8e292fcf7 service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:59:54.135439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ab57d-7b3c-45c7-a5b8-4e98b88b7ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:59:54.136104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ab57d-7b3c-45c7-a5b8-4e98b88b7ac7 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:54.136384 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ab57d-7b3c-45c7-a5b8-4e98b88b7ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:54.136658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ab57d-7b3c-45c7-a5b8-4e98b88b7ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:54.138837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6d1ab57d-7b3c-45c7-a5b8-4e98b88b7ac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:54.157011 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ab57d-7b3c-45c7-a5b8-4e98b88b7ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:59:54.160332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ab57d-7b3c-45c7-a5b8-4e98b88b7ac7 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:59:54.178379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1169/2337] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:59:55.065611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffee28-8e3a-4452-85d8-86c3ec1e6ec8 service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:59:55.091413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffee28-8e3a-4452-85d8-86c3ec1e6ec8 service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:59:55.096084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9275ab0-6ddc-4c0e-a470-60c1bdc2b9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:59:55.096808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9275ab0-6ddc-4c0e-a470-60c1bdc2b9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.097114 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9275ab0-6ddc-4c0e-a470-60c1bdc2b9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.097387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9275ab0-6ddc-4c0e-a470-60c1bdc2b9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.099729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e9275ab0-6ddc-4c0e-a470-60c1bdc2b9f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:55.112705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9275ab0-6ddc-4c0e-a470-60c1bdc2b9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:59:55.119783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9275ab0-6ddc-4c0e-a470-60c1bdc2b9f0 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:59:55.137507 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1169/2338] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:59:55.292312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61246e8-21bb-4400-9586-538d40f61c93 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.292893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61246e8-21bb-4400-9586-538d40f61c93 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.293286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61246e8-21bb-4400-9586-538d40f61c93 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.297750 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1170/2339] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 19:59:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:59:55.308727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98896934-e78e-4359-ad18-d803431520b9 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.309028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98896934-e78e-4359-ad18-d803431520b9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.309300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98896934-e78e-4359-ad18-d803431520b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.358429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-98896934-e78e-4359-ad18-d803431520b9 None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:59:55.359662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-98896934-e78e-4359-ad18-d803431520b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:55.373466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1170/2340] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:59:55.394480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61246e8-21bb-4400-9586-538d40f61c93 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:59:55.409659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61246e8-21bb-4400-9586-538d40f61c93 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:59:55.413772 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dfdf9-7bac-49ac-b17c-ec44c675b218 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:59:55.414491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dfdf9-7bac-49ac-b17c-ec44c675b218 service glance] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.414770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dfdf9-7bac-49ac-b17c-ec44c675b218 service glance] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.415063 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dfdf9-7bac-49ac-b17c-ec44c675b218 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.427317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dfdf9-7bac-49ac-b17c-ec44c675b218 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:59:55.428916 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dfdf9-7bac-49ac-b17c-ec44c675b218 service glance] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:59:55.441877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1171/2341] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:59:55.525743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525b5e5-e114-4ef4-bbbe-2f61ec0e731f None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.526171 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525b5e5-e114-4ef4-bbbe-2f61ec0e731f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.526539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525b5e5-e114-4ef4-bbbe-2f61ec0e731f None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.528545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1171/2342] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 19:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:59:55.533926 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9f42-e44e-43a7-98ec-7b07e9026044 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.534256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9f42-e44e-43a7-98ec-7b07e9026044 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.534531 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab9f42-e44e-43a7-98ec-7b07e9026044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.554383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-89ab9f42-e44e-43a7-98ec-7b07e9026044 None None] MFA Rules not processed for user `c2e837368cdc4df29d945a4c8e662a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:59:55.555493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-89ab9f42-e44e-43a7-98ec-7b07e9026044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:55.562175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1172/2343] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:59:55.574430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525b5e5-e114-4ef4-bbbe-2f61ec0e731f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:59:55.576223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f525b5e5-e114-4ef4-bbbe-2f61ec0e731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:55.591191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525b5e5-e114-4ef4-bbbe-2f61ec0e731f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:59:55.595486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef74b7-5d5a-4378-9616-c1a4da1bf748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:59:55.596150 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef74b7-5d5a-4378-9616-c1a4da1bf748 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.596427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef74b7-5d5a-4378-9616-c1a4da1bf748 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.596694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef74b7-5d5a-4378-9616-c1a4da1bf748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.605139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef74b7-5d5a-4378-9616-c1a4da1bf748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:59:55.606664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef74b7-5d5a-4378-9616-c1a4da1bf748 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:59:55.615413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1172/2344] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 19:59:55.712427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b960b0b-1ff3-434f-a0c9-61ea3740de6a None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.712852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b960b0b-1ff3-434f-a0c9-61ea3740de6a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.713266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b960b0b-1ff3-434f-a0c9-61ea3740de6a None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.715819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1173/2345] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 19:59:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 19:59:55.722647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055b63c-9285-4a73-b642-8161e8b7f368 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.722953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055b63c-9285-4a73-b642-8161e8b7f368 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.723236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055b63c-9285-4a73-b642-8161e8b7f368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.743099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c055b63c-9285-4a73-b642-8161e8b7f368 None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 19:59:55.744335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c055b63c-9285-4a73-b642-8161e8b7f368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 19:59:55.754539 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1173/2346] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 19:59:55.765843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b960b0b-1ff3-434f-a0c9-61ea3740de6a None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 19:59:55.783714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b960b0b-1ff3-434f-a0c9-61ea3740de6a None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 19:59:55.787434 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6eba3-1fd8-43db-8162-8abfb9d570b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 19:59:55.788078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6eba3-1fd8-43db-8162-8abfb9d570b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 19:59:55.788351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6eba3-1fd8-43db-8162-8abfb9d570b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 19:59:55.788615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6eba3-1fd8-43db-8162-8abfb9d570b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 19:59:55.799524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6eba3-1fd8-43db-8162-8abfb9d570b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 19:59:55.800951 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6eba3-1fd8-43db-8162-8abfb9d570b3 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 19:59:55.812973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1174/2347] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:00:00.490154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055b63c-9285-4a73-b642-8161e8b7f368 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:00:00.502718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055b63c-9285-4a73-b642-8161e8b7f368 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:00:00.508979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016c2d6-fb55-4602-8778-03ad3aba2c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:00:00.509670 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016c2d6-fb55-4602-8778-03ad3aba2c74 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:00:00.509972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016c2d6-fb55-4602-8778-03ad3aba2c74 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:00:00.510266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016c2d6-fb55-4602-8778-03ad3aba2c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:00:00.512225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5016c2d6-fb55-4602-8778-03ad3aba2c74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:00:00.579050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016c2d6-fb55-4602-8778-03ad3aba2c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:00:00.580727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016c2d6-fb55-4602-8778-03ad3aba2c74 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:00:00.591697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1174/2348] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:00:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:00:03.834881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078e98d-b525-4fdc-8fae-7a6473cb79b7 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:00:03.835711 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078e98d-b525-4fdc-8fae-7a6473cb79b7 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:00:03.836131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078e98d-b525-4fdc-8fae-7a6473cb79b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:00:03.855513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-f078e98d-b525-4fdc-8fae-7a6473cb79b7 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:00:03.856698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f078e98d-b525-4fdc-8fae-7a6473cb79b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:00:03.865241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1175/2349] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 20:00:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:00:03.878436 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016c2d6-fb55-4602-8778-03ad3aba2c74 service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:00:03.890779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016c2d6-fb55-4602-8778-03ad3aba2c74 service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:00:03.897988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2f2ff-c2fd-4f99-8933-5442e64422bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:00:03.898677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2f2ff-c2fd-4f99-8933-5442e64422bb service swift] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:00:03.898953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2f2ff-c2fd-4f99-8933-5442e64422bb service swift] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:00:03.899223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2f2ff-c2fd-4f99-8933-5442e64422bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:00:03.909326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2f2ff-c2fd-4f99-8933-5442e64422bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:00:03.910298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2f2ff-c2fd-4f99-8933-5442e64422bb service swift] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:00:03.922154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1175/2350] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:00:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:00:13.283169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078e98d-b525-4fdc-8fae-7a6473cb79b7 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:00:13.284790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f078e98d-b525-4fdc-8fae-7a6473cb79b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:00:13.377964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078e98d-b525-4fdc-8fae-7a6473cb79b7 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:00:13.385189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:00:13.386232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:00:13.386523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:00:13.386798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] PATH_INFO: `/v3/users/707de543471349dcb40e1f374a14baed` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:00:13.388917 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=707de543471349dcb40e1f374a14baed)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:00:13.392525 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:00:13.455281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707de543471349dcb40e1f374a14baed'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:13.456140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707de543471349dcb40e1f374a14baed'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:13.456950 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707de543471349dcb40e1f374a14baed'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:13.467904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707de543471349dcb40e1f374a14baed'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:13.481661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-ce86ea57-b3e6-45b0-9176-b6b42b60b492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707de543471349dcb40e1f374a14baed'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:13.510751 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1176/2351] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:00:13 2022] DELETE /identity/v3/users/707de543471349dcb40e1f374a14baed => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:00:13.785567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2f2ff-c2fd-4f99-8933-5442e64422bb service swift] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:00:13.803428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2f2ff-c2fd-4f99-8933-5442e64422bb service swift] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:00:13.905648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:00:13.914334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:00:13.914868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:00:13.915380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] PATH_INFO: `/v3/projects/65348cbf3b5d4178a385b1c1031b5ff6` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:00:13.916974 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65348cbf3b5d4178a385b1c1031b5ff6)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:00:13.919040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:00:13.976687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65348cbf3b5d4178a385b1c1031b5ff6', 'request_id': 'req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:13.983709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65348cbf3b5d4178a385b1c1031b5ff6', 'request_id': 'req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:13.996042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65348cbf3b5d4178a385b1c1031b5ff6', 'request_id': 'req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:14.011371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] The token cache is being invalidate because project 65348cbf3b5d4178a385b1c1031b5ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:00:14.011712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:14.012556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:00:14.014806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1176/2352] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:00:13 2022] DELETE /identity/v3/projects/65348cbf3b5d4178a385b1c1031b5ff6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:00:38.940446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d153202-6b4b-4663-ae0b-70b04e47ed33 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:00:38.941560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d153202-6b4b-4663-ae0b-70b04e47ed33 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:00:38.941814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d153202-6b4b-4663-ae0b-70b04e47ed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:00:38.977123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4d153202-6b4b-4663-ae0b-70b04e47ed33 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:00:38.978066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4d153202-6b4b-4663-ae0b-70b04e47ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:00:39.067885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1177/2353] 10.222.0.49 () {58 vars in 967 bytes} [Tue Mar 22 20:00:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:00:39.100721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:00:39.103089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:00:39.194177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ac0b-1e1a-4be9-982a-e30120a164c5 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:00:39.201075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed101b8-6c20-4419-a072-baa8d89f5911 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:00:39.203767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed101b8-6c20-4419-a072-baa8d89f5911 service swift] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:00:39.203767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed101b8-6c20-4419-a072-baa8d89f5911 service swift] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:00:39.203767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed101b8-6c20-4419-a072-baa8d89f5911 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:00:39.211962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed101b8-6c20-4419-a072-baa8d89f5911 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:00:39.213643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed101b8-6c20-4419-a072-baa8d89f5911 service swift] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:00:39.222825 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1177/2354] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:00:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:00:45.471308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d153202-6b4b-4663-ae0b-70b04e47ed33 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:00:45.473019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4d153202-6b4b-4663-ae0b-70b04e47ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:00:45.562598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d153202-6b4b-4663-ae0b-70b04e47ed33 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:00:45.570301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:00:45.571033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:00:45.571342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:00:45.571628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:00:45.573585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:00:45.637482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:00:45.639137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:00:45.650367 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1178/2355] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:00:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:00:46.736388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956dc96-3349-4703-9d28-4f7524171f22 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:00:46.737006 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956dc96-3349-4703-9d28-4f7524171f22 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:00:46.737006 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956dc96-3349-4703-9d28-4f7524171f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:00:46.756450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7956dc96-3349-4703-9d28-4f7524171f22 None None] MFA Rules not processed for user `0207c3cb9a3e408f81ff3f86c5e70285`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:00:46.757690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7956dc96-3349-4703-9d28-4f7524171f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:00:46.824163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1178/2356] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:00:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:01:02.536564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:01:02.538274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:01:02.555873 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68d51c-5a29-490d-8d4c-37844c27e636 service nova] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:01:02.564723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493a8c3-c8a5-4858-b990-31d606bf9584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:01:02.565456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a8c3-c8a5-4858-b990-31d606bf9584 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:01:02.565832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a8c3-c8a5-4858-b990-31d606bf9584 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:01:02.566141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a8c3-c8a5-4858-b990-31d606bf9584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:01:02.568090 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9493a8c3-c8a5-4858-b990-31d606bf9584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:01:02.650721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493a8c3-c8a5-4858-b990-31d606bf9584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:01:02.652624 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493a8c3-c8a5-4858-b990-31d606bf9584 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:01:02.663614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1179/2357] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:01:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:01:06.691172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e27c6-c5db-479c-9146-b109a0ce02e3 None None] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:01:06.692385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e27c6-c5db-479c-9146-b109a0ce02e3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:01:06.692843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e27c6-c5db-479c-9146-b109a0ce02e3 None None] PATH_INFO: `/` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:01:06.703117 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1179/2358] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 20:01:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 20:01:06.719314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8fed5-0f67-4c62-9e95-1b159de47429 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:01:06.720122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8fed5-0f67-4c62-9e95-1b159de47429 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:01:06.720991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8fed5-0f67-4c62-9e95-1b159de47429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:01:06.760764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-98c8fed5-0f67-4c62-9e95-1b159de47429 None None] MFA Rules not processed for user `c2e837368cdc4df29d945a4c8e662a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:01:06.763349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-98c8fed5-0f67-4c62-9e95-1b159de47429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:01:06.844714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1180/2359] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 20:01:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:01:06.857395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e27c6-c5db-479c-9146-b109a0ce02e3 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:01:06.860485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f13e27c6-c5db-479c-9146-b109a0ce02e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:01:06.881962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e27c6-c5db-479c-9146-b109a0ce02e3 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:01:06.888058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff652b45-8962-4994-9230-5a5fa3d3e089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:01:06.889123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652b45-8962-4994-9230-5a5fa3d3e089 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:01:06.889611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652b45-8962-4994-9230-5a5fa3d3e089 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:01:06.890152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652b45-8962-4994-9230-5a5fa3d3e089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:01:06.904155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff652b45-8962-4994-9230-5a5fa3d3e089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:01:06.907164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff652b45-8962-4994-9230-5a5fa3d3e089 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:01:06.922477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1180/2360] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:01:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:01:07.030191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625545-ec2c-49d3-b7e4-e2c73575ecf1 None None] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:01:07.030727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625545-ec2c-49d3-b7e4-e2c73575ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:01:07.031217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625545-ec2c-49d3-b7e4-e2c73575ecf1 None None] PATH_INFO: `/` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:01:07.034947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1181/2361] 10.222.0.49 () {54 vars in 921 bytes} [Tue Mar 22 20:01:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 22 20:01:07.043127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b951a-0d9b-4fea-b8c6-511cfc1f149d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:01:07.043707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b951a-0d9b-4fea-b8c6-511cfc1f149d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:01:07.044068 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b951a-0d9b-4fea-b8c6-511cfc1f149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:01:07.075544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d51b951a-0d9b-4fea-b8c6-511cfc1f149d None None] MFA Rules not processed for user `7f74d49fc68344899f70efb85eb1c97d`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:01:07.078064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d51b951a-0d9b-4fea-b8c6-511cfc1f149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:01:07.094261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1181/2362] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Mar 22 20:01:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:01:07.105634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02625545-ec2c-49d3-b7e4-e2c73575ecf1 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:01:07.117490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02625545-ec2c-49d3-b7e4-e2c73575ecf1 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:01:07.121051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb1816-d7a4-4d65-b84e-a4c1cf08f7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:01:07.121699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb1816-d7a4-4d65-b84e-a4c1cf08f7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:01:07.122000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb1816-d7a4-4d65-b84e-a4c1cf08f7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:01:07.122272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb1816-d7a4-4d65-b84e-a4c1cf08f7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:01:07.133410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb1816-d7a4-4d65-b84e-a4c1cf08f7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:01:07.134900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb1816-d7a4-4d65-b84e-a4c1cf08f7a3 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:01:07.147596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1182/2363] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:01:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:01:14.548370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b951a-0d9b-4fea-b8c6-511cfc1f149d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:01:14.561376 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b951a-0d9b-4fea-b8c6-511cfc1f149d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:01:14.569160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58fbf-14e6-40da-b37d-2430710f84da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:01:14.569802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58fbf-14e6-40da-b37d-2430710f84da service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:01:14.570233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58fbf-14e6-40da-b37d-2430710f84da service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:01:14.570514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58fbf-14e6-40da-b37d-2430710f84da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:01:14.572758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e0e58fbf-14e6-40da-b37d-2430710f84da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:01:14.641115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e58fbf-14e6-40da-b37d-2430710f84da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:01:14.642761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e58fbf-14e6-40da-b37d-2430710f84da service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:01:14.652160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1182/2364] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:01:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:01:29.126187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509de2-e3ec-4ab1-bdd0-8546a0ec0ada None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:01:29.126824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509de2-e3ec-4ab1-bdd0-8546a0ec0ada None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:01:29.126824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509de2-e3ec-4ab1-bdd0-8546a0ec0ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:01:29.145463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d6509de2-e3ec-4ab1-bdd0-8546a0ec0ada None None] MFA Rules not processed for user `9680269cd8504c36b6027040e185a817`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:01:29.146747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d6509de2-e3ec-4ab1-bdd0-8546a0ec0ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:01:29.154454 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1183/2365] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:01:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:10.793663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58fbf-14e6-40da-b37d-2430710f84da service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:10.805629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58fbf-14e6-40da-b37d-2430710f84da service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:10.812833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577827-dbda-4e28-a091-a9c62b1801f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:10.813512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577827-dbda-4e28-a091-a9c62b1801f6 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:10.813800 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577827-dbda-4e28-a091-a9c62b1801f6 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:10.814103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577827-dbda-4e28-a091-a9c62b1801f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:10.816408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-89577827-dbda-4e28-a091-a9c62b1801f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:10.876739 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89577827-dbda-4e28-a091-a9c62b1801f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:10.878425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89577827-dbda-4e28-a091-a9c62b1801f6 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:10.887963 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1183/2366] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:02:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:02:17.373149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509de2-e3ec-4ab1-bdd0-8546a0ec0ada None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:17.375245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d6509de2-e3ec-4ab1-bdd0-8546a0ec0ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:17.475040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509de2-e3ec-4ab1-bdd0-8546a0ec0ada None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:17.482317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:17.482930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:17.483212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:17.483505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:17.486138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:17.499206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:17.501030 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:17.514359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1184/2367] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:02:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:02:20.695174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03165-53b6-4bdd-a0ad-26423524df23 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:20.695737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03165-53b6-4bdd-a0ad-26423524df23 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:20.695861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03165-53b6-4bdd-a0ad-26423524df23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:20.715803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-e8c03165-53b6-4bdd-a0ad-26423524df23 None None] MFA Rules not processed for user `dc6e41197447403b9d424c1637d231aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:20.717017 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e8c03165-53b6-4bdd-a0ad-26423524df23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:20.725529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1184/2368] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:38.923056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:38.924941 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:38.938110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6e30-892e-47cc-bd56-1f9b4d4be480 service placement] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:38.942695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37db3c2-840d-4746-a0e4-205cc2676318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:38.943195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db3c2-840d-4746-a0e4-205cc2676318 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:38.943484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db3c2-840d-4746-a0e4-205cc2676318 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:38.943763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db3c2-840d-4746-a0e4-205cc2676318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:38.946221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d37db3c2-840d-4746-a0e4-205cc2676318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:39.015661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37db3c2-840d-4746-a0e4-205cc2676318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:39.017111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37db3c2-840d-4746-a0e4-205cc2676318 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:39.034557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1185/2369] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:02:42.967573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c03165-53b6-4bdd-a0ad-26423524df23 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:42.969390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e8c03165-53b6-4bdd-a0ad-26423524df23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:42.990840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c03165-53b6-4bdd-a0ad-26423524df23 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:42.990840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:42.991643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:42.991927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:42.992208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] PATH_INFO: `/v3/users/0207c3cb9a3e408f81ff3f86c5e70285` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:42.993506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0207c3cb9a3e408f81ff3f86c5e70285)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:42.995470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:43.062680 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0207c3cb9a3e408f81ff3f86c5e70285'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.075833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0207c3cb9a3e408f81ff3f86c5e70285'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.084701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0207c3cb9a3e408f81ff3f86c5e70285'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.085322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0207c3cb9a3e408f81ff3f86c5e70285'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.096600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f2e32b17-24fc-40aa-9da5-e5496c347125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0207c3cb9a3e408f81ff3f86c5e70285'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.104210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1185/2370] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:02:42 2022] DELETE /identity/v3/users/0207c3cb9a3e408f81ff3f86c5e70285 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:02:43.305844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37db3c2-840d-4746-a0e4-205cc2676318 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:43.316882 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37db3c2-840d-4746-a0e4-205cc2676318 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:43.443116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:43.445339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:43.448313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:43.448815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] PATH_INFO: `/v3/projects/09fa13f497274b059b64db9cafbf68cd` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:43.450450 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=09fa13f497274b059b64db9cafbf68cd)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:43.452844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:43.521999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09fa13f497274b059b64db9cafbf68cd', 'request_id': 'req-a9d74c49-dd99-419e-a1a7-bf96cce418ce'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.530443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09fa13f497274b059b64db9cafbf68cd', 'request_id': 'req-a9d74c49-dd99-419e-a1a7-bf96cce418ce'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.540101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09fa13f497274b059b64db9cafbf68cd', 'request_id': 'req-a9d74c49-dd99-419e-a1a7-bf96cce418ce'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.570619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] The token cache is being invalidate because project 09fa13f497274b059b64db9cafbf68cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:02:43.571623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.573513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a9d74c49-dd99-419e-a1a7-bf96cce418ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:43.574876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1186/2371] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:02:43 2022] DELETE /identity/v3/projects/09fa13f497274b059b64db9cafbf68cd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:02:43.581030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70ac1e-d9fa-4341-a62f-96b26d5e06db None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:43.582494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70ac1e-d9fa-4341-a62f-96b26d5e06db None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:43.582494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70ac1e-d9fa-4341-a62f-96b26d5e06db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:43.604667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4c70ac1e-d9fa-4341-a62f-96b26d5e06db None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:43.605929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4c70ac1e-d9fa-4341-a62f-96b26d5e06db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:43.681526 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1186/2372] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:43.689834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba8a2c-1526-49f5-bbda-d9fe3f8d0d41 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:43.690240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba8a2c-1526-49f5-bbda-d9fe3f8d0d41 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:43.690647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba8a2c-1526-49f5-bbda-d9fe3f8d0d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:43.711802 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-a1ba8a2c-1526-49f5-bbda-d9fe3f8d0d41 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:43.713212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a1ba8a2c-1526-49f5-bbda-d9fe3f8d0d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:43.727380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1187/2373] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:02:43.733789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70ac1e-d9fa-4341-a62f-96b26d5e06db None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:43.745854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70ac1e-d9fa-4341-a62f-96b26d5e06db None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:43.757206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d8bde-93ef-4b10-8204-8994f0fb0f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:43.761142 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d8bde-93ef-4b10-8204-8994f0fb0f15 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:43.761849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d8bde-93ef-4b10-8204-8994f0fb0f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:43.762445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d8bde-93ef-4b10-8204-8994f0fb0f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:43.763735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d8bde-93ef-4b10-8204-8994f0fb0f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:02:43.764035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d8bde-93ef-4b10-8204-8994f0fb0f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:43.765816 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d8bde-93ef-4b10-8204-8994f0fb0f15 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:43.783881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1187/2374] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:02:43.788443 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba8a2c-1526-49f5-bbda-d9fe3f8d0d41 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:43.798920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba8a2c-1526-49f5-bbda-d9fe3f8d0d41 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:43.805018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb6747-19eb-47a7-bb49-b3c3190b685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:43.805300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb6747-19eb-47a7-bb49-b3c3190b685b admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:43.805571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb6747-19eb-47a7-bb49-b3c3190b685b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:43.805854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb6747-19eb-47a7-bb49-b3c3190b685b admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:43.806771 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb6747-19eb-47a7-bb49-b3c3190b685b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:43.808744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb6747-19eb-47a7-bb49-b3c3190b685b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:43.877314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1188/2375] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:02:43 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:02:43.878904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d8bde-93ef-4b10-8204-8994f0fb0f15 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:43.891526 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d8bde-93ef-4b10-8204-8994f0fb0f15 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:43.975164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89848501-6c02-4170-924a-cc2fbf069cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:43.976003 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89848501-6c02-4170-924a-cc2fbf069cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:43.976090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89848501-6c02-4170-924a-cc2fbf069cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:43.976390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89848501-6c02-4170-924a-cc2fbf069cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:43.977075 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89848501-6c02-4170-924a-cc2fbf069cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:43.979438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89848501-6c02-4170-924a-cc2fbf069cb3 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:44.003479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1188/2376] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:02:43 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:02:44.008540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb6747-19eb-47a7-bb49-b3c3190b685b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:44.019486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb6747-19eb-47a7-bb49-b3c3190b685b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:44.025185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ae56-9183-4b0d-aa7b-3239fc21fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:44.026400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ae56-9183-4b0d-aa7b-3239fc21fcaf admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:44.026760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ae56-9183-4b0d-aa7b-3239fc21fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:44.027038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80ae56-9183-4b0d-aa7b-3239fc21fcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:44.027810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80ae56-9183-4b0d-aa7b-3239fc21fcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:44.029679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80ae56-9183-4b0d-aa7b-3239fc21fcaf admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:44.044413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1189/2377] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:02:44.049027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89848501-6c02-4170-924a-cc2fbf069cb3 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:44.059833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89848501-6c02-4170-924a-cc2fbf069cb3 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:44.064803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f3185-a589-4814-943c-37bc2d5d0bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:44.065572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3185-a589-4814-943c-37bc2d5d0bba admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:44.065925 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3185-a589-4814-943c-37bc2d5d0bba admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:44.066301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3185-a589-4814-943c-37bc2d5d0bba admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:44.067589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f3185-a589-4814-943c-37bc2d5d0bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:44.069451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f3185-a589-4814-943c-37bc2d5d0bba admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:44.080915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1189/2378] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:02:44.087289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ae56-9183-4b0d-aa7b-3239fc21fcaf admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:44.098997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80ae56-9183-4b0d-aa7b-3239fc21fcaf admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:44.104597 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf9b44-ab59-4929-beea-82afc530c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:44.105787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf9b44-ab59-4929-beea-82afc530c986 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:44.106140 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf9b44-ab59-4929-beea-82afc530c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:44.107375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf9b44-ab59-4929-beea-82afc530c986 admin admin] PATH_INFO: `/v3/projects/6bde6a8921ef4e218a3dd021265cb2af/users/38573760d7424aefbe4f328d6cb82884/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:44.125148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf9b44-ab59-4929-beea-82afc530c986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bde6a8921ef4e218a3dd021265cb2af, user_id=38573760d7424aefbe4f328d6cb82884, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:44.128039 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf9b44-ab59-4929-beea-82afc530c986 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:44.148104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1190/2379] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:02:44 2022] PUT /identity/v3/projects/6bde6a8921ef4e218a3dd021265cb2af/users/38573760d7424aefbe4f328d6cb82884/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:02:44.162818 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b6ad-cc67-462c-a3e3-9ede87ec592f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:44.163094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b6ad-cc67-462c-a3e3-9ede87ec592f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:44.163393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b6ad-cc67-462c-a3e3-9ede87ec592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:44.197133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-ec89b6ad-cc67-462c-a3e3-9ede87ec592f None None] MFA Rules not processed for user `38573760d7424aefbe4f328d6cb82884`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:44.198468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ec89b6ad-cc67-462c-a3e3-9ede87ec592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:44.287308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1190/2380] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:44.300001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf9b44-ab59-4929-beea-82afc530c986 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:44.302308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f3bf9b44-ab59-4929-beea-82afc530c986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:44.398705 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf9b44-ab59-4929-beea-82afc530c986 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:44.408486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a47c01-bd4c-4b87-9dde-cd12ecee5f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:44.409295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a47c01-bd4c-4b87-9dde-cd12ecee5f23 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:44.409611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a47c01-bd4c-4b87-9dde-cd12ecee5f23 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:44.410200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a47c01-bd4c-4b87-9dde-cd12ecee5f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:44.421436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a47c01-bd4c-4b87-9dde-cd12ecee5f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:44.423135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a47c01-bd4c-4b87-9dde-cd12ecee5f23 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:44.434203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1191/2381] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:02:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:02:46.985862 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b22c-5136-42b6-a7e2-31e64bedc010 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:46.986454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b22c-5136-42b6-a7e2-31e64bedc010 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:46.986454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3b22c-5136-42b6-a7e2-31e64bedc010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:47.010216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-8ab3b22c-5136-42b6-a7e2-31e64bedc010 None None] MFA Rules not processed for user `3763d1d3f1cd46058e1979062d084de5`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:47.011461 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-8ab3b22c-5136-42b6-a7e2-31e64bedc010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:47.076001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1191/2382] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:47.320815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a47c01-bd4c-4b87-9dde-cd12ecee5f23 service nova] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:47.398274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a47c01-bd4c-4b87-9dde-cd12ecee5f23 service nova] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:47.404256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:47.405137 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:47.405382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:47.405651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] PATH_INFO: `/v3/users/38573760d7424aefbe4f328d6cb82884` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:47.406898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=38573760d7424aefbe4f328d6cb82884)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:47.409227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:47.467316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38573760d7424aefbe4f328d6cb82884'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:47.468647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38573760d7424aefbe4f328d6cb82884'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:47.468832 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38573760d7424aefbe4f328d6cb82884'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:47.479555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38573760d7424aefbe4f328d6cb82884'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:47.488426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38573760d7424aefbe4f328d6cb82884'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:47.518313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1192/2383] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:02:47 2022] DELETE /identity/v3/users/38573760d7424aefbe4f328d6cb82884 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:02:47.524212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3f5d-78e0-4097-adcd-15f6fa53e930 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:47.524690 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3f5d-78e0-4097-adcd-15f6fa53e930 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:47.525158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3f5d-78e0-4097-adcd-15f6fa53e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:47.547631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-bb8b3f5d-78e0-4097-adcd-15f6fa53e930 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:47.548854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-bb8b3f5d-78e0-4097-adcd-15f6fa53e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:47.640907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1192/2384] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:47.654601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:47.656139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:47.720024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58a20-c16e-4218-87db-cdea3cebe5ed admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:47.723951 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec01d2-70b2-48ec-8fa9-bb33ae0d6fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:47.724622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec01d2-70b2-48ec-8fa9-bb33ae0d6fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:47.724895 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec01d2-70b2-48ec-8fa9-bb33ae0d6fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:47.725160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec01d2-70b2-48ec-8fa9-bb33ae0d6fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:47.735948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec01d2-70b2-48ec-8fa9-bb33ae0d6fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:47.737398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec01d2-70b2-48ec-8fa9-bb33ae0d6fe5 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:47.750959 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1193/2385] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:02:48.141996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b3f5d-78e0-4097-adcd-15f6fa53e930 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:48.144481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-bb8b3f5d-78e0-4097-adcd-15f6fa53e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:48.167767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b3f5d-78e0-4097-adcd-15f6fa53e930 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:48.173510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:48.174715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.175166 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.175620 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] PATH_INFO: `/v3/projects/6bde6a8921ef4e218a3dd021265cb2af` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.177156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bde6a8921ef4e218a3dd021265cb2af)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:48.179442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:48.236076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bde6a8921ef4e218a3dd021265cb2af', 'request_id': 'req-d079d09d-256e-4d81-bf9e-3cc985700e82'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:48.248052 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bde6a8921ef4e218a3dd021265cb2af', 'request_id': 'req-d079d09d-256e-4d81-bf9e-3cc985700e82'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:48.259433 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bde6a8921ef4e218a3dd021265cb2af', 'request_id': 'req-d079d09d-256e-4d81-bf9e-3cc985700e82'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:48.272976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] The token cache is being invalidate because project 6bde6a8921ef4e218a3dd021265cb2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:02:48.273259 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:48.274044 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d079d09d-256e-4d81-bf9e-3cc985700e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:48.275759 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1193/2386] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:02:48 2022] DELETE /identity/v3/projects/6bde6a8921ef4e218a3dd021265cb2af => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:02:48.284189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8f8b-6acb-47ee-95a6-856e6186e3c6 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.284594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8f8b-6acb-47ee-95a6-856e6186e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.284879 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8f8b-6acb-47ee-95a6-856e6186e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.308900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-957e8f8b-6acb-47ee-95a6-856e6186e3c6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:48.310212 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-957e8f8b-6acb-47ee-95a6-856e6186e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:48.379373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1194/2387] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:48.388809 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ae183-bb12-4f8a-8103-f62199e35e81 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.389081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ae183-bb12-4f8a-8103-f62199e35e81 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.389351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ae183-bb12-4f8a-8103-f62199e35e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.409291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-9d2ae183-bb12-4f8a-8103-f62199e35e81 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:48.410678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9d2ae183-bb12-4f8a-8103-f62199e35e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:48.419851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1194/2388] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:48.424599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e8f8b-6acb-47ee-95a6-856e6186e3c6 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:48.435810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e8f8b-6acb-47ee-95a6-856e6186e3c6 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:48.441530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42632f-6231-44e8-b73e-5f80ba834d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:48.442229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42632f-6231-44e8-b73e-5f80ba834d86 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.442530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42632f-6231-44e8-b73e-5f80ba834d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.442798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42632f-6231-44e8-b73e-5f80ba834d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.443528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42632f-6231-44e8-b73e-5f80ba834d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:02:48.443829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42632f-6231-44e8-b73e-5f80ba834d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:48.445446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42632f-6231-44e8-b73e-5f80ba834d86 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:48.458933 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1195/2389] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:02:48.464172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ae183-bb12-4f8a-8103-f62199e35e81 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:48.477756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ae183-bb12-4f8a-8103-f62199e35e81 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:48.482807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b0f4a-a27f-4d81-b0de-46f6fc783b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:48.483647 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b0f4a-a27f-4d81-b0de-46f6fc783b52 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.483959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b0f4a-a27f-4d81-b0de-46f6fc783b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.484224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b0f4a-a27f-4d81-b0de-46f6fc783b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.484935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b0f4a-a27f-4d81-b0de-46f6fc783b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:48.487216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b0f4a-a27f-4d81-b0de-46f6fc783b52 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:48.517736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1195/2390] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:02:48 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:02:48.523518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42632f-6231-44e8-b73e-5f80ba834d86 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:48.535966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42632f-6231-44e8-b73e-5f80ba834d86 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:48.619834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a10f9-ac33-47ab-9b40-98552cd183c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:48.621044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a10f9-ac33-47ab-9b40-98552cd183c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.621548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a10f9-ac33-47ab-9b40-98552cd183c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.622358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a10f9-ac33-47ab-9b40-98552cd183c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.624066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a10f9-ac33-47ab-9b40-98552cd183c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:48.628203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a10f9-ac33-47ab-9b40-98552cd183c8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:48.657353 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1196/2391] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:02:48 2022] POST /identity/v3/users => generated 283 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:02:48.662918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b0f4a-a27f-4d81-b0de-46f6fc783b52 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:48.674062 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b0f4a-a27f-4d81-b0de-46f6fc783b52 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:48.679905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cd9a4-d63a-4c3f-b865-c897076ac4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:48.680603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cd9a4-d63a-4c3f-b865-c897076ac4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.680894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cd9a4-d63a-4c3f-b865-c897076ac4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.681170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cd9a4-d63a-4c3f-b865-c897076ac4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.681894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cd9a4-d63a-4c3f-b865-c897076ac4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:48.683560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cd9a4-d63a-4c3f-b865-c897076ac4c5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:48.694986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1196/2392] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:02:48.699447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a10f9-ac33-47ab-9b40-98552cd183c8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:48.713572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a10f9-ac33-47ab-9b40-98552cd183c8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:48.719738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4e5b6-4cc4-43c9-a80a-dedb122d03a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:48.720418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e5b6-4cc4-43c9-a80a-dedb122d03a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.720680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e5b6-4cc4-43c9-a80a-dedb122d03a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.720959 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e5b6-4cc4-43c9-a80a-dedb122d03a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.721718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4e5b6-4cc4-43c9-a80a-dedb122d03a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:48.723480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4e5b6-4cc4-43c9-a80a-dedb122d03a9 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:48.734595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1197/2393] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:02:48.739809 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cd9a4-d63a-4c3f-b865-c897076ac4c5 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:48.750623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cd9a4-d63a-4c3f-b865-c897076ac4c5 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:48.755587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ec149-4d92-4a87-8fb2-a3400231d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:48.756496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ec149-4d92-4a87-8fb2-a3400231d086 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.756778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ec149-4d92-4a87-8fb2-a3400231d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.757051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ec149-4d92-4a87-8fb2-a3400231d086 admin admin] PATH_INFO: `/v3/projects/b28a30716bdf45dc84e9e90c985ba351/users/14f8f52443714a5385ee4eaaf577d530/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.773533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ec149-4d92-4a87-8fb2-a3400231d086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28a30716bdf45dc84e9e90c985ba351, user_id=14f8f52443714a5385ee4eaaf577d530, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:48.776287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ec149-4d92-4a87-8fb2-a3400231d086 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:48.794435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1197/2394] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:02:48 2022] PUT /identity/v3/projects/b28a30716bdf45dc84e9e90c985ba351/users/14f8f52443714a5385ee4eaaf577d530/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:02:48.809498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb8bb4-a011-4da0-bb90-aceeed02090c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:48.809773 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb8bb4-a011-4da0-bb90-aceeed02090c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:48.810300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb8bb4-a011-4da0-bb90-aceeed02090c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:48.841801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-dbcb8bb4-a011-4da0-bb90-aceeed02090c None None] MFA Rules not processed for user `14f8f52443714a5385ee4eaaf577d530`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:48.843067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-dbcb8bb4-a011-4da0-bb90-aceeed02090c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:48.945593 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1198/2395] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:48.967694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ec149-4d92-4a87-8fb2-a3400231d086 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:48.970855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f85ec149-4d92-4a87-8fb2-a3400231d086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:49.053896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ec149-4d92-4a87-8fb2-a3400231d086 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:49.058967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90676c0c-c05c-4601-a2e3-b04e5069884e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:49.059797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676c0c-c05c-4601-a2e3-b04e5069884e service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:49.060084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676c0c-c05c-4601-a2e3-b04e5069884e service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:49.060372 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676c0c-c05c-4601-a2e3-b04e5069884e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:49.071956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90676c0c-c05c-4601-a2e3-b04e5069884e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:49.073499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90676c0c-c05c-4601-a2e3-b04e5069884e service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:49.086103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1198/2396] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:02:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:02:57.749611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb8bb4-a011-4da0-bb90-aceeed02090c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:57.819627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb8bb4-a011-4da0-bb90-aceeed02090c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:57.826718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:57.827601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:57.827880 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:57.828134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] PATH_INFO: `/v3/users/14f8f52443714a5385ee4eaaf577d530` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:57.829386 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f8f52443714a5385ee4eaaf577d530)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:57.831446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:57.882864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f8f52443714a5385ee4eaaf577d530'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:57.883625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f8f52443714a5385ee4eaaf577d530'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:57.884385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f8f52443714a5385ee4eaaf577d530'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:57.894166 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f8f52443714a5385ee4eaaf577d530'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:57.902199 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f8f52443714a5385ee4eaaf577d530'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:57.925364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1199/2397] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:02:57 2022] DELETE /identity/v3/users/14f8f52443714a5385ee4eaaf577d530 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:02:57.931422 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22497-f64a-4ae0-a20b-83811e6c975b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:57.931967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22497-f64a-4ae0-a20b-83811e6c975b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:57.931967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22497-f64a-4ae0-a20b-83811e6c975b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:57.952853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-99b22497-f64a-4ae0-a20b-83811e6c975b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:57.954121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-99b22497-f64a-4ae0-a20b-83811e6c975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:58.019277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1199/2398] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:02:58.029196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:58.030747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:58.094723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70217acf-01de-4b2b-b0e4-3b03ab842475 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:58.099017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a8457-aaeb-42de-be39-efe6ec545038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:58.099647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a8457-aaeb-42de-be39-efe6ec545038 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.099936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a8457-aaeb-42de-be39-efe6ec545038 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.100202 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a8457-aaeb-42de-be39-efe6ec545038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.109366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a8457-aaeb-42de-be39-efe6ec545038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:58.110829 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a8457-aaeb-42de-be39-efe6ec545038 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:58.120359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1200/2399] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:02:58.427547 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22497-f64a-4ae0-a20b-83811e6c975b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:58.429001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-99b22497-f64a-4ae0-a20b-83811e6c975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:58.444750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22497-f64a-4ae0-a20b-83811e6c975b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:58.452128 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:58.453392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.453636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.453922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] PATH_INFO: `/v3/projects/b28a30716bdf45dc84e9e90c985ba351` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.455246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28a30716bdf45dc84e9e90c985ba351)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:58.457371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:58.507951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28a30716bdf45dc84e9e90c985ba351', 'request_id': 'req-f01491a7-52f5-4488-b789-8b3255645718'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:58.514296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28a30716bdf45dc84e9e90c985ba351', 'request_id': 'req-f01491a7-52f5-4488-b789-8b3255645718'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:58.525135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28a30716bdf45dc84e9e90c985ba351', 'request_id': 'req-f01491a7-52f5-4488-b789-8b3255645718'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:58.538464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] The token cache is being invalidate because project b28a30716bdf45dc84e9e90c985ba351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:02:58.538757 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:58.539571 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f01491a7-52f5-4488-b789-8b3255645718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:58.541435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1200/2400] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:02:58 2022] DELETE /identity/v3/projects/b28a30716bdf45dc84e9e90c985ba351 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:02:58.546831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9edc4-7716-407f-b08b-17c85264ec19 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.547118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9edc4-7716-407f-b08b-17c85264ec19 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.547394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9edc4-7716-407f-b08b-17c85264ec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.566577 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3bc9edc4-7716-407f-b08b-17c85264ec19 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:58.567770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3bc9edc4-7716-407f-b08b-17c85264ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:58.629758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1201/2401] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:58.637453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2836c1-9fba-4e74-acc2-11af84adb7fa None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.637737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2836c1-9fba-4e74-acc2-11af84adb7fa None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.638055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2836c1-9fba-4e74-acc2-11af84adb7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.660281 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-2a2836c1-9fba-4e74-acc2-11af84adb7fa None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:58.661684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2a2836c1-9fba-4e74-acc2-11af84adb7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:58.671020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1201/2402] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:58.676227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9edc4-7716-407f-b08b-17c85264ec19 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:58.688847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9edc4-7716-407f-b08b-17c85264ec19 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:58.695822 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219613fa-0efc-4f85-b04e-6a6cef58d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:58.696468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219613fa-0efc-4f85-b04e-6a6cef58d74c admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.696740 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219613fa-0efc-4f85-b04e-6a6cef58d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.697003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219613fa-0efc-4f85-b04e-6a6cef58d74c admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.697731 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219613fa-0efc-4f85-b04e-6a6cef58d74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:02:58.698051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219613fa-0efc-4f85-b04e-6a6cef58d74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:58.699632 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219613fa-0efc-4f85-b04e-6a6cef58d74c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:58.712331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1202/2403] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:02:58.717331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2836c1-9fba-4e74-acc2-11af84adb7fa None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:58.726946 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2836c1-9fba-4e74-acc2-11af84adb7fa None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:58.732183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb200e0-6595-4ee7-98f5-1b71cffbe9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:58.732840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb200e0-6595-4ee7-98f5-1b71cffbe9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.733119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb200e0-6595-4ee7-98f5-1b71cffbe9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.733390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb200e0-6595-4ee7-98f5-1b71cffbe9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.734141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb200e0-6595-4ee7-98f5-1b71cffbe9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:58.736081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb200e0-6595-4ee7-98f5-1b71cffbe9d3 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:58.769496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1202/2404] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:02:58 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:02:58.774232 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219613fa-0efc-4f85-b04e-6a6cef58d74c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:58.788096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219613fa-0efc-4f85-b04e-6a6cef58d74c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:58.852775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303325fc-b99d-4a00-ac5a-30e1c23ce74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:58.853449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303325fc-b99d-4a00-ac5a-30e1c23ce74b admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.853731 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303325fc-b99d-4a00-ac5a-30e1c23ce74b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.854124 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303325fc-b99d-4a00-ac5a-30e1c23ce74b admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.854830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303325fc-b99d-4a00-ac5a-30e1c23ce74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:58.856754 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303325fc-b99d-4a00-ac5a-30e1c23ce74b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:58.879823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1203/2405] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:02:58 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:02:58.884654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb200e0-6595-4ee7-98f5-1b71cffbe9d3 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:58.896759 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb200e0-6595-4ee7-98f5-1b71cffbe9d3 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:58.902996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e259e4-1efb-418a-bf4d-4d1110f49cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:58.903675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e259e4-1efb-418a-bf4d-4d1110f49cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.903945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e259e4-1efb-418a-bf4d-4d1110f49cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.904219 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e259e4-1efb-418a-bf4d-4d1110f49cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.905002 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e259e4-1efb-418a-bf4d-4d1110f49cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:58.906735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e259e4-1efb-418a-bf4d-4d1110f49cf3 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:58.920858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1203/2406] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:02:58.925177 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303325fc-b99d-4a00-ac5a-30e1c23ce74b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:58.936327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303325fc-b99d-4a00-ac5a-30e1c23ce74b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:58.942892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a986123-381f-4cd5-8475-9a175ba70733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:58.943659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a986123-381f-4cd5-8475-9a175ba70733 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.943948 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a986123-381f-4cd5-8475-9a175ba70733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.944201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a986123-381f-4cd5-8475-9a175ba70733 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.944926 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a986123-381f-4cd5-8475-9a175ba70733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:58.946536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a986123-381f-4cd5-8475-9a175ba70733 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:58.957845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1204/2407] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:02:58.962305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e259e4-1efb-418a-bf4d-4d1110f49cf3 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:58.972830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e259e4-1efb-418a-bf4d-4d1110f49cf3 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:58.977684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd64e73-b3bb-49e1-ae3a-431428231aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:58.978603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64e73-b3bb-49e1-ae3a-431428231aae admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:58.978881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64e73-b3bb-49e1-ae3a-431428231aae admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:58.979155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64e73-b3bb-49e1-ae3a-431428231aae admin admin] PATH_INFO: `/v3/projects/72292d6df0294459ac015f3398448bd5/users/b985e68892fd4a2f8b2e632bf20fce8a/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:58.995072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64e73-b3bb-49e1-ae3a-431428231aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=72292d6df0294459ac015f3398448bd5, user_id=b985e68892fd4a2f8b2e632bf20fce8a, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:58.997723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64e73-b3bb-49e1-ae3a-431428231aae admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:59.015780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1204/2408] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:02:58 2022] PUT /identity/v3/projects/72292d6df0294459ac015f3398448bd5/users/b985e68892fd4a2f8b2e632bf20fce8a/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:02:59.029349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b43899-7cb4-431d-910d-ad55ea4ede81 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:59.029642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b43899-7cb4-431d-910d-ad55ea4ede81 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:59.030011 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b43899-7cb4-431d-910d-ad55ea4ede81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:59.064371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-f9b43899-7cb4-431d-910d-ad55ea4ede81 None None] MFA Rules not processed for user `b985e68892fd4a2f8b2e632bf20fce8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:59.065575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f9b43899-7cb4-431d-910d-ad55ea4ede81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:59.141042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1205/2409] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:59.154349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd64e73-b3bb-49e1-ae3a-431428231aae admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:59.156673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9cd64e73-b3bb-49e1-ae3a-431428231aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:59.243187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd64e73-b3bb-49e1-ae3a-431428231aae admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:59.249078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22228bd-2dfa-41f1-914c-b5558bcc88d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:59.249730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22228bd-2dfa-41f1-914c-b5558bcc88d7 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:59.250058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22228bd-2dfa-41f1-914c-b5558bcc88d7 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:59.250329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22228bd-2dfa-41f1-914c-b5558bcc88d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:59.258432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22228bd-2dfa-41f1-914c-b5558bcc88d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:59.260026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22228bd-2dfa-41f1-914c-b5558bcc88d7 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:59.268811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1205/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:02:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:02:59.454733 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b43899-7cb4-431d-910d-ad55ea4ede81 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:59.536619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b43899-7cb4-431d-910d-ad55ea4ede81 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:59.542206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:59.543082 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:59.543336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:59.543635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] PATH_INFO: `/v3/users/b985e68892fd4a2f8b2e632bf20fce8a` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:59.544892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b985e68892fd4a2f8b2e632bf20fce8a)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:59.546936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:59.613903 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b985e68892fd4a2f8b2e632bf20fce8a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:59.614644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b985e68892fd4a2f8b2e632bf20fce8a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:59.615450 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b985e68892fd4a2f8b2e632bf20fce8a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:59.625106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b985e68892fd4a2f8b2e632bf20fce8a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:59.634233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b985e68892fd4a2f8b2e632bf20fce8a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:02:59.652294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1206/2411] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:02:59 2022] DELETE /identity/v3/users/b985e68892fd4a2f8b2e632bf20fce8a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:02:59.657185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b862b-89ae-4bb3-aed5-36ebefc77f93 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:59.657472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b862b-89ae-4bb3-aed5-36ebefc77f93 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:59.657758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b862b-89ae-4bb3-aed5-36ebefc77f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:59.676060 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-bf5b862b-89ae-4bb3-aed5-36ebefc77f93 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:02:59.678105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-bf5b862b-89ae-4bb3-aed5-36ebefc77f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:59.737293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1206/2412] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:02:59.747458 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:02:59.748962 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:02:59.810990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952fc06-2ccf-4468-8a25-a336d8285643 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:02:59.815740 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beed3f1-a67d-4313-bdac-6fb6e6ee3d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:02:59.816419 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beed3f1-a67d-4313-bdac-6fb6e6ee3d95 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:02:59.816711 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beed3f1-a67d-4313-bdac-6fb6e6ee3d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:02:59.816980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beed3f1-a67d-4313-bdac-6fb6e6ee3d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:02:59.826810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beed3f1-a67d-4313-bdac-6fb6e6ee3d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:02:59.829582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beed3f1-a67d-4313-bdac-6fb6e6ee3d95 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:02:59.846136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1207/2413] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:00.159314 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b862b-89ae-4bb3-aed5-36ebefc77f93 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:00.161169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-bf5b862b-89ae-4bb3-aed5-36ebefc77f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:00.180253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b862b-89ae-4bb3-aed5-36ebefc77f93 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:00.186798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:00.188898 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.189863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.190183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] PATH_INFO: `/v3/projects/72292d6df0294459ac015f3398448bd5` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.192644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72292d6df0294459ac015f3398448bd5)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:00.195518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:00.244623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72292d6df0294459ac015f3398448bd5', 'request_id': 'req-1309297a-305c-4b03-8dfa-5ddc2b29702e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:00.250804 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72292d6df0294459ac015f3398448bd5', 'request_id': 'req-1309297a-305c-4b03-8dfa-5ddc2b29702e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:00.259272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72292d6df0294459ac015f3398448bd5', 'request_id': 'req-1309297a-305c-4b03-8dfa-5ddc2b29702e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:00.271491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] The token cache is being invalidate because project 72292d6df0294459ac015f3398448bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:03:00.271778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:00.272465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-1309297a-305c-4b03-8dfa-5ddc2b29702e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:00.274054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1207/2414] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:03:00 2022] DELETE /identity/v3/projects/72292d6df0294459ac015f3398448bd5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:00.279141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9af05-6916-4f8b-a509-8e027885b5bf None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.279552 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9af05-6916-4f8b-a509-8e027885b5bf None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.279911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9af05-6916-4f8b-a509-8e027885b5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.298747 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-a8f9af05-6916-4f8b-a509-8e027885b5bf None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:00.299969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a8f9af05-6916-4f8b-a509-8e027885b5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:00.361722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1208/2415] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:00.370470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce581e9-a0b2-4374-bdc2-e5d2d73e414f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.370850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce581e9-a0b2-4374-bdc2-e5d2d73e414f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.370976 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce581e9-a0b2-4374-bdc2-e5d2d73e414f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.392290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-8ce581e9-a0b2-4374-bdc2-e5d2d73e414f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:00.393600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-8ce581e9-a0b2-4374-bdc2-e5d2d73e414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:00.403666 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1208/2416] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:00.408053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9af05-6916-4f8b-a509-8e027885b5bf None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:00.417897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9af05-6916-4f8b-a509-8e027885b5bf None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:00.422582 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e90f-8c5f-45c8-924b-737557a27851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:00.423306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e90f-8c5f-45c8-924b-737557a27851 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.423619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e90f-8c5f-45c8-924b-737557a27851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.423930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e90f-8c5f-45c8-924b-737557a27851 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.424698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6e90f-8c5f-45c8-924b-737557a27851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:03:00.425053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6e90f-8c5f-45c8-924b-737557a27851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:00.427355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6e90f-8c5f-45c8-924b-737557a27851 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:00.439110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1209/2417] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:03:00.444066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce581e9-a0b2-4374-bdc2-e5d2d73e414f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:00.453230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce581e9-a0b2-4374-bdc2-e5d2d73e414f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:00.458695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b30d9-ae60-47ec-b03f-2ee6ef533a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:00.459427 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b30d9-ae60-47ec-b03f-2ee6ef533a97 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.459711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b30d9-ae60-47ec-b03f-2ee6ef533a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.459984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b30d9-ae60-47ec-b03f-2ee6ef533a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.460697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b30d9-ae60-47ec-b03f-2ee6ef533a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:00.462731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b30d9-ae60-47ec-b03f-2ee6ef533a97 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:00.491950 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1209/2418] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:03:00 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:03:00.496783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e90f-8c5f-45c8-924b-737557a27851 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:00.508175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e90f-8c5f-45c8-924b-737557a27851 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:00.571243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5695d-0c35-430e-9cf6-619cf5186b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:00.571932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5695d-0c35-430e-9cf6-619cf5186b9a admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.572214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5695d-0c35-430e-9cf6-619cf5186b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.572483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5695d-0c35-430e-9cf6-619cf5186b9a admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.573161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5695d-0c35-430e-9cf6-619cf5186b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:00.575132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5695d-0c35-430e-9cf6-619cf5186b9a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:00.597584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1210/2419] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:03:00 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:03:00.602131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b30d9-ae60-47ec-b03f-2ee6ef533a97 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:00.613695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b30d9-ae60-47ec-b03f-2ee6ef533a97 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:00.618923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831949bf-a585-4493-89a9-4f876953985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:00.619601 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831949bf-a585-4493-89a9-4f876953985e admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.619902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831949bf-a585-4493-89a9-4f876953985e admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.620173 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831949bf-a585-4493-89a9-4f876953985e admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.620911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831949bf-a585-4493-89a9-4f876953985e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:00.622565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831949bf-a585-4493-89a9-4f876953985e admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:00.633811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1210/2420] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:00.638259 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5695d-0c35-430e-9cf6-619cf5186b9a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:00.649250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5695d-0c35-430e-9cf6-619cf5186b9a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:00.654128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7900aa0-1baf-4166-811a-a8f4d952ddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:00.654718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7900aa0-1baf-4166-811a-a8f4d952ddb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.655000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7900aa0-1baf-4166-811a-a8f4d952ddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.655276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7900aa0-1baf-4166-811a-a8f4d952ddb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.656039 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7900aa0-1baf-4166-811a-a8f4d952ddb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:00.657634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7900aa0-1baf-4166-811a-a8f4d952ddb5 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:00.669601 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1211/2421] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:00.674196 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831949bf-a585-4493-89a9-4f876953985e admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:00.685992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831949bf-a585-4493-89a9-4f876953985e admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:00.691177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afe558-fe0c-4f96-b164-2bdd67f113fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:00.692706 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe558-fe0c-4f96-b164-2bdd67f113fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.693050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe558-fe0c-4f96-b164-2bdd67f113fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.693388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe558-fe0c-4f96-b164-2bdd67f113fc admin admin] PATH_INFO: `/v3/projects/8e788924fc7a4c42847a15cac31d8c99/users/43250cc77ad04d7c9dafa2b6ccae6920/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.709598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afe558-fe0c-4f96-b164-2bdd67f113fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e788924fc7a4c42847a15cac31d8c99, user_id=43250cc77ad04d7c9dafa2b6ccae6920, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:00.712316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afe558-fe0c-4f96-b164-2bdd67f113fc admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:00.726688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1211/2422] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:03:00 2022] PUT /identity/v3/projects/8e788924fc7a4c42847a15cac31d8c99/users/43250cc77ad04d7c9dafa2b6ccae6920/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:00.738385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78d64e-de23-4feb-9e2a-e22b6b95dc01 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.738679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78d64e-de23-4feb-9e2a-e22b6b95dc01 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.739037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78d64e-de23-4feb-9e2a-e22b6b95dc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.766536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8f78d64e-de23-4feb-9e2a-e22b6b95dc01 None None] MFA Rules not processed for user `43250cc77ad04d7c9dafa2b6ccae6920`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:00.767764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8f78d64e-de23-4feb-9e2a-e22b6b95dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:00.835748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1212/2423] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:00.841214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afe558-fe0c-4f96-b164-2bdd67f113fc admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:00.904927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afe558-fe0c-4f96-b164-2bdd67f113fc admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:00.909821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af818e0a-4e8f-4e78-979c-edd37ce619c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:00.910579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af818e0a-4e8f-4e78-979c-edd37ce619c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:00.910895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af818e0a-4e8f-4e78-979c-edd37ce619c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:00.911167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af818e0a-4e8f-4e78-979c-edd37ce619c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:00.911828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af818e0a-4e8f-4e78-979c-edd37ce619c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:00.913764 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af818e0a-4e8f-4e78-979c-edd37ce619c3 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:00.941392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1212/2424] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:03:00 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:03:00.945544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78d64e-de23-4feb-9e2a-e22b6b95dc01 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:00.957520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78d64e-de23-4feb-9e2a-e22b6b95dc01 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:01.015390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfd3bb-7c82-4661-b544-c134c65f0ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:01.016084 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfd3bb-7c82-4661-b544-c134c65f0ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:01.016362 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfd3bb-7c82-4661-b544-c134c65f0ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:01.016667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfd3bb-7c82-4661-b544-c134c65f0ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:01.017398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfd3bb-7c82-4661-b544-c134c65f0ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:01.019400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfd3bb-7c82-4661-b544-c134c65f0ff8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:01.041468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1213/2425] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:03:00 2022] POST /identity/v3/users => generated 310 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:03:01.046499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af818e0a-4e8f-4e78-979c-edd37ce619c3 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:01.057656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af818e0a-4e8f-4e78-979c-edd37ce619c3 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:01.062997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69695d-64ef-49c9-bd1d-5f935edd65a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:01.063747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69695d-64ef-49c9-bd1d-5f935edd65a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:01.064101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69695d-64ef-49c9-bd1d-5f935edd65a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:01.064450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69695d-64ef-49c9-bd1d-5f935edd65a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:01.065246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69695d-64ef-49c9-bd1d-5f935edd65a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:01.067057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69695d-64ef-49c9-bd1d-5f935edd65a3 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:01.077846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1213/2426] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:01.082323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfd3bb-7c82-4661-b544-c134c65f0ff8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:01.095495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfd3bb-7c82-4661-b544-c134c65f0ff8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:01.102060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f874d-cb17-4474-ae3f-612b75056050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:01.102977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f874d-cb17-4474-ae3f-612b75056050 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:01.103454 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f874d-cb17-4474-ae3f-612b75056050 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:01.103573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f874d-cb17-4474-ae3f-612b75056050 admin admin] PATH_INFO: `/v3/projects/4806c7f191d8449b94d11c38aea7a22c/users/d72b9021ea054e1eb131ce067700fce3/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:01.135679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f874d-cb17-4474-ae3f-612b75056050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4806c7f191d8449b94d11c38aea7a22c, user_id=d72b9021ea054e1eb131ce067700fce3, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:01.135897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69695d-64ef-49c9-bd1d-5f935edd65a3 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:01.137672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0b69695d-64ef-49c9-bd1d-5f935edd65a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:01.139115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f874d-cb17-4474-ae3f-612b75056050 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:01.158082 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1214/2427] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:03:01 2022] PUT /identity/v3/projects/4806c7f191d8449b94d11c38aea7a22c/users/d72b9021ea054e1eb131ce067700fce3/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:03:01.162325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f874d-cb17-4474-ae3f-612b75056050 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:01.220444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69695d-64ef-49c9-bd1d-5f935edd65a3 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:01.233645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f874d-cb17-4474-ae3f-612b75056050 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:01.238762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d623c-9c57-428a-9326-ac1b7624a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:01.239437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d623c-9c57-428a-9326-ac1b7624a555 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:01.239713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d623c-9c57-428a-9326-ac1b7624a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:01.239997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d623c-9c57-428a-9326-ac1b7624a555 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:01.240713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d623c-9c57-428a-9326-ac1b7624a555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:01.242362 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d623c-9c57-428a-9326-ac1b7624a555 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:01.252695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1215/2428] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:01.257516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d623c-9c57-428a-9326-ac1b7624a555 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:01.268276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d623c-9c57-428a-9326-ac1b7624a555 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:01.272839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83360b1-9c53-49e3-964b-90cd79c89fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:01.273736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83360b1-9c53-49e3-964b-90cd79c89fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:01.274048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83360b1-9c53-49e3-964b-90cd79c89fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:01.274327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83360b1-9c53-49e3-964b-90cd79c89fa6 admin admin] PATH_INFO: `/v3/projects/4806c7f191d8449b94d11c38aea7a22c/users/d72b9021ea054e1eb131ce067700fce3/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:01.276452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83360b1-9c53-49e3-964b-90cd79c89fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4806c7f191d8449b94d11c38aea7a22c, user_id=d72b9021ea054e1eb131ce067700fce3, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:01.279130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83360b1-9c53-49e3-964b-90cd79c89fa6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:01.289023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:01.290070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:01.290214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1216/2429] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:03:01 2022] PUT /identity/v3/projects/4806c7f191d8449b94d11c38aea7a22c/users/d72b9021ea054e1eb131ce067700fce3/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:03:01.290324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:01.290727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:01.292691 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:01.303681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b6b6-bf22-4adc-a983-d8c149e3b194 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:01.303970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b6b6-bf22-4adc-a983-d8c149e3b194 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:01.304247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b6b6-bf22-4adc-a983-d8c149e3b194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:01.305763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:01.307561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:01.319235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1214/2430] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:03:01.332756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0963b6b6-bf22-4adc-a983-d8c149e3b194 None None] MFA Rules not processed for user `d72b9021ea054e1eb131ce067700fce3`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:01.334258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0963b6b6-bf22-4adc-a983-d8c149e3b194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:01.416977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1217/2431] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:01 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:01.428005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:01.429471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:01.487224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a437-ee2a-497e-98cd-d719c5ee53c2 service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:01.539937 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4cc92-5903-42e5-851e-bf7e8b6cc27e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:01.540740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4cc92-5903-42e5-851e-bf7e8b6cc27e service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:01.541131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4cc92-5903-42e5-851e-bf7e8b6cc27e service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:01.541502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4cc92-5903-42e5-851e-bf7e8b6cc27e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:01.551786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4cc92-5903-42e5-851e-bf7e8b6cc27e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:01.553392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4cc92-5903-42e5-851e-bf7e8b6cc27e service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:01.564813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1215/2432] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:01.715909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b6b6-bf22-4adc-a983-d8c149e3b194 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:01.726121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b6b6-bf22-4adc-a983-d8c149e3b194 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:01.729980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e351f-1f7e-47df-a649-ebd353ffead7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:01.730707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e351f-1f7e-47df-a649-ebd353ffead7 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:01.731047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e351f-1f7e-47df-a649-ebd353ffead7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:01.731380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e351f-1f7e-47df-a649-ebd353ffead7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:01.793153 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e351f-1f7e-47df-a649-ebd353ffead7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:01.794887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e351f-1f7e-47df-a649-ebd353ffead7 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:01.807913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1218/2433] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:01 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:11.296077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4cc92-5903-42e5-851e-bf7e8b6cc27e service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:11.364933 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4cc92-5903-42e5-851e-bf7e8b6cc27e service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:11.369958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:11.370849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:11.371135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:11.371412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] PATH_INFO: `/v3/users/43250cc77ad04d7c9dafa2b6ccae6920` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:11.372673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=43250cc77ad04d7c9dafa2b6ccae6920)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:11.374672 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:11.427705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43250cc77ad04d7c9dafa2b6ccae6920'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:11.440609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43250cc77ad04d7c9dafa2b6ccae6920'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:11.451358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43250cc77ad04d7c9dafa2b6ccae6920'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:11.452170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43250cc77ad04d7c9dafa2b6ccae6920'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:11.459712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43250cc77ad04d7c9dafa2b6ccae6920'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:11.466165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1216/2434] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:03:11 2022] DELETE /identity/v3/users/43250cc77ad04d7c9dafa2b6ccae6920 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:11.473009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d9931-60ff-4e60-a9df-e49d9d6ef60d None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:11.473855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d9931-60ff-4e60-a9df-e49d9d6ef60d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:11.474163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d9931-60ff-4e60-a9df-e49d9d6ef60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:11.492139 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-ff7d9931-60ff-4e60-a9df-e49d9d6ef60d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:11.493308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ff7d9931-60ff-4e60-a9df-e49d9d6ef60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:11.553690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1219/2435] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:11.563746 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:11.565327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:11.625493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa84043-f1e6-43fd-8f59-c8a548cab4ac admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:11.629972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065e80-1304-4cbc-b12c-08a21c4f5f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:11.630639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065e80-1304-4cbc-b12c-08a21c4f5f5c service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:11.630916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065e80-1304-4cbc-b12c-08a21c4f5f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:11.631188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065e80-1304-4cbc-b12c-08a21c4f5f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:11.640794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86065e80-1304-4cbc-b12c-08a21c4f5f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:11.642263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86065e80-1304-4cbc-b12c-08a21c4f5f5c service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:11.651780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1217/2436] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:11.930931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d9931-60ff-4e60-a9df-e49d9d6ef60d None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:11.932611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ff7d9931-60ff-4e60-a9df-e49d9d6ef60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:11.945543 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d9931-60ff-4e60-a9df-e49d9d6ef60d None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:11.950677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:11.951602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:11.951983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:11.952143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] PATH_INFO: `/v3/projects/8e788924fc7a4c42847a15cac31d8c99` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:11.954003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e788924fc7a4c42847a15cac31d8c99)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:11.955943 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:12.014365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e788924fc7a4c42847a15cac31d8c99', 'request_id': 'req-f41f96d1-5e3a-4d22-983b-239d698a472c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.021547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e788924fc7a4c42847a15cac31d8c99', 'request_id': 'req-f41f96d1-5e3a-4d22-983b-239d698a472c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.027660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e788924fc7a4c42847a15cac31d8c99', 'request_id': 'req-f41f96d1-5e3a-4d22-983b-239d698a472c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.043284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] The token cache is being invalidate because project 8e788924fc7a4c42847a15cac31d8c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:03:12.043573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.044191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.045737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1220/2437] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:03:11 2022] DELETE /identity/v3/projects/8e788924fc7a4c42847a15cac31d8c99 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:12.049829 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065e80-1304-4cbc-b12c-08a21c4f5f5c service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:12.060216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065e80-1304-4cbc-b12c-08a21c4f5f5c service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:12.119587 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:12.120480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:12.120737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:12.121030 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] PATH_INFO: `/v3/users/d72b9021ea054e1eb131ce067700fce3` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:12.122263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72b9021ea054e1eb131ce067700fce3)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:12.124199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:12.173595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72b9021ea054e1eb131ce067700fce3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.186597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72b9021ea054e1eb131ce067700fce3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.197723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72b9021ea054e1eb131ce067700fce3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.198788 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72b9021ea054e1eb131ce067700fce3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.209598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-eb2a3653-75f0-4136-958e-4f345861b232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72b9021ea054e1eb131ce067700fce3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.219138 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1218/2438] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:03:12 2022] DELETE /identity/v3/users/d72b9021ea054e1eb131ce067700fce3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:03:12.756756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:12.758341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:12.772026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f96d1-5e3a-4d22-983b-239d698a472c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:12.828690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:12.829661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:12.829984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:12.830252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] PATH_INFO: `/v3/projects/4806c7f191d8449b94d11c38aea7a22c` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:12.831425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4806c7f191d8449b94d11c38aea7a22c)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:12.834553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:12.883281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4806c7f191d8449b94d11c38aea7a22c', 'request_id': 'req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.888383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4806c7f191d8449b94d11c38aea7a22c', 'request_id': 'req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.894884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4806c7f191d8449b94d11c38aea7a22c', 'request_id': 'req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.915573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] The token cache is being invalidate because project 4806c7f191d8449b94d11c38aea7a22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:03:12.915922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.916836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-8d667f4a-fbf0-4026-bd2a-9594ad6d5785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:12.918516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1221/2439] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:03:12 2022] DELETE /identity/v3/projects/4806c7f191d8449b94d11c38aea7a22c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:12.924290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765b6d3-472b-42e5-b4a8-3771cc4ec9d6 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:12.924828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765b6d3-472b-42e5-b4a8-3771cc4ec9d6 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:12.924922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765b6d3-472b-42e5-b4a8-3771cc4ec9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:12.944590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-9765b6d3-472b-42e5-b4a8-3771cc4ec9d6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:12.945776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9765b6d3-472b-42e5-b4a8-3771cc4ec9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:13.009217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1219/2440] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:13.017640 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e9f1-d040-49ae-80b2-22032bdf3bbe None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.017981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e9f1-d040-49ae-80b2-22032bdf3bbe None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.018262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e9f1-d040-49ae-80b2-22032bdf3bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.039739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8b69e9f1-d040-49ae-80b2-22032bdf3bbe None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:13.040958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8b69e9f1-d040-49ae-80b2-22032bdf3bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:13.050256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1222/2441] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:13.055235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765b6d3-472b-42e5-b4a8-3771cc4ec9d6 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:13.065236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765b6d3-472b-42e5-b4a8-3771cc4ec9d6 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:13.071269 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db8dab-349d-4c7c-ac4a-69ee494b8ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:13.071909 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db8dab-349d-4c7c-ac4a-69ee494b8ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.072193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db8dab-349d-4c7c-ac4a-69ee494b8ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.072464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db8dab-349d-4c7c-ac4a-69ee494b8ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.073222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db8dab-349d-4c7c-ac4a-69ee494b8ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:03:13.073528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db8dab-349d-4c7c-ac4a-69ee494b8ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:13.075163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db8dab-349d-4c7c-ac4a-69ee494b8ad8 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:13.087389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1220/2442] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:03:13.092299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e9f1-d040-49ae-80b2-22032bdf3bbe None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:13.103010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e9f1-d040-49ae-80b2-22032bdf3bbe None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:13.108315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98c5a9-6276-4275-a49f-7f7b51c452c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:13.108977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98c5a9-6276-4275-a49f-7f7b51c452c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.109236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98c5a9-6276-4275-a49f-7f7b51c452c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.109502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98c5a9-6276-4275-a49f-7f7b51c452c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.110229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98c5a9-6276-4275-a49f-7f7b51c452c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:13.112136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98c5a9-6276-4275-a49f-7f7b51c452c1 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:13.144476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1223/2443] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:03:13 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:03:13.150353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db8dab-349d-4c7c-ac4a-69ee494b8ad8 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:13.166357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db8dab-349d-4c7c-ac4a-69ee494b8ad8 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:13.234849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685a42e-3606-4ecd-94ed-d2a768f4c438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:13.235531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685a42e-3606-4ecd-94ed-d2a768f4c438 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.235813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685a42e-3606-4ecd-94ed-d2a768f4c438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.236082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685a42e-3606-4ecd-94ed-d2a768f4c438 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.236779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685a42e-3606-4ecd-94ed-d2a768f4c438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:13.238737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685a42e-3606-4ecd-94ed-d2a768f4c438 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:13.260187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1221/2444] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:03:13 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:03:13.264461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98c5a9-6276-4275-a49f-7f7b51c452c1 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:13.275312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98c5a9-6276-4275-a49f-7f7b51c452c1 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:13.281093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770f39-19b9-477f-a8bc-8235cb9a3197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:13.281765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770f39-19b9-477f-a8bc-8235cb9a3197 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.282077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770f39-19b9-477f-a8bc-8235cb9a3197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.282357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770f39-19b9-477f-a8bc-8235cb9a3197 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.283069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09770f39-19b9-477f-a8bc-8235cb9a3197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:13.284687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09770f39-19b9-477f-a8bc-8235cb9a3197 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:13.295718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1224/2445] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:13.300210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685a42e-3606-4ecd-94ed-d2a768f4c438 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:13.310572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685a42e-3606-4ecd-94ed-d2a768f4c438 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:13.315776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c0dd-0379-4b6f-8b06-f4fa96714c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:13.316481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c0dd-0379-4b6f-8b06-f4fa96714c9c admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.316761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c0dd-0379-4b6f-8b06-f4fa96714c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.317032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c0dd-0379-4b6f-8b06-f4fa96714c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.317756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c0dd-0379-4b6f-8b06-f4fa96714c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:13.319399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c0dd-0379-4b6f-8b06-f4fa96714c9c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:13.329727 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1222/2446] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:13.334304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770f39-19b9-477f-a8bc-8235cb9a3197 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:13.344704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770f39-19b9-477f-a8bc-8235cb9a3197 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:13.349614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16664b-ad4a-45e9-a29d-91cecdf10431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:13.350549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16664b-ad4a-45e9-a29d-91cecdf10431 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.350830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16664b-ad4a-45e9-a29d-91cecdf10431 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.351114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16664b-ad4a-45e9-a29d-91cecdf10431 admin admin] PATH_INFO: `/v3/projects/4e85d2c1d0fd47ed86115e6915e2e6df/users/1ad66fcb15a14eadabfd9c65071c5df3/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.366776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16664b-ad4a-45e9-a29d-91cecdf10431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e85d2c1d0fd47ed86115e6915e2e6df, user_id=1ad66fcb15a14eadabfd9c65071c5df3, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:13.369498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16664b-ad4a-45e9-a29d-91cecdf10431 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:13.384683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1225/2447] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:03:13 2022] PUT /identity/v3/projects/4e85d2c1d0fd47ed86115e6915e2e6df/users/1ad66fcb15a14eadabfd9c65071c5df3/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:13.396339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355673ea-cc86-47bb-a8c4-a2e6ef04f378 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.396661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355673ea-cc86-47bb-a8c4-a2e6ef04f378 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.396910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355673ea-cc86-47bb-a8c4-a2e6ef04f378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.430317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-355673ea-cc86-47bb-a8c4-a2e6ef04f378 None None] MFA Rules not processed for user `1ad66fcb15a14eadabfd9c65071c5df3`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:13.431530 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-355673ea-cc86-47bb-a8c4-a2e6ef04f378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:13.497553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1223/2448] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:13.509733 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16664b-ad4a-45e9-a29d-91cecdf10431 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:13.511994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ea16664b-ad4a-45e9-a29d-91cecdf10431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:13.575713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16664b-ad4a-45e9-a29d-91cecdf10431 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:13.580261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6e184-2f7b-4dcb-9f15-9815a4e8c8a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:13.580917 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6e184-2f7b-4dcb-9f15-9815a4e8c8a6 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.581199 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6e184-2f7b-4dcb-9f15-9815a4e8c8a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.581477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6e184-2f7b-4dcb-9f15-9815a4e8c8a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.590994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6e184-2f7b-4dcb-9f15-9815a4e8c8a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:13.592446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6e184-2f7b-4dcb-9f15-9815a4e8c8a6 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:13.602086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1226/2449] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:13.626504 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355673ea-cc86-47bb-a8c4-a2e6ef04f378 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:13.699035 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355673ea-cc86-47bb-a8c4-a2e6ef04f378 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:13.704734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:13.705654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.705958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.706252 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] PATH_INFO: `/v3/users/1ad66fcb15a14eadabfd9c65071c5df3` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.707616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad66fcb15a14eadabfd9c65071c5df3)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:13.709569 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:13.766073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad66fcb15a14eadabfd9c65071c5df3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:13.784285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad66fcb15a14eadabfd9c65071c5df3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:13.793827 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad66fcb15a14eadabfd9c65071c5df3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:13.794573 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad66fcb15a14eadabfd9c65071c5df3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:13.801744 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad66fcb15a14eadabfd9c65071c5df3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:13.807704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1224/2450] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:03:13 2022] DELETE /identity/v3/users/1ad66fcb15a14eadabfd9c65071c5df3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:13.812341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a09b7-daba-4a0c-9309-b6b665f5d895 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.812852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a09b7-daba-4a0c-9309-b6b665f5d895 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.812961 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a09b7-daba-4a0c-9309-b6b665f5d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.830897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-813a09b7-daba-4a0c-9309-b6b665f5d895 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:13.832345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-813a09b7-daba-4a0c-9309-b6b665f5d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:13.899694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1227/2451] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:13.909980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:13.911751 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:13.977808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7db36-91e6-4c82-9575-cebf2501c8c5 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:13.982265 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b561eb-3f65-4fd6-b602-d66632e9f716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:13.982910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b561eb-3f65-4fd6-b602-d66632e9f716 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:13.983191 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b561eb-3f65-4fd6-b602-d66632e9f716 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:13.983596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b561eb-3f65-4fd6-b602-d66632e9f716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:13.993397 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b561eb-3f65-4fd6-b602-d66632e9f716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:13.994905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b561eb-3f65-4fd6-b602-d66632e9f716 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:14.004499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1225/2452] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:14.296314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a09b7-daba-4a0c-9309-b6b665f5d895 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:14.297717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-813a09b7-daba-4a0c-9309-b6b665f5d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:14.312245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a09b7-daba-4a0c-9309-b6b665f5d895 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:14.318687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:14.319551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.319863 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.320077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] PATH_INFO: `/v3/projects/4e85d2c1d0fd47ed86115e6915e2e6df` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.321347 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e85d2c1d0fd47ed86115e6915e2e6df)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:14.323311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:14.377079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e85d2c1d0fd47ed86115e6915e2e6df', 'request_id': 'req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:14.383146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e85d2c1d0fd47ed86115e6915e2e6df', 'request_id': 'req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:14.389570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e85d2c1d0fd47ed86115e6915e2e6df', 'request_id': 'req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:14.404286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] The token cache is being invalidate because project 4e85d2c1d0fd47ed86115e6915e2e6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:03:14.404568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:14.405162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0e1374b1-efc0-4c55-8d8c-ea5f8e82b7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:14.406802 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1228/2453] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:03:14 2022] DELETE /identity/v3/projects/4e85d2c1d0fd47ed86115e6915e2e6df => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:14.412817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b440ee-2efc-42a5-a92c-140b4bccd0f2 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.413101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b440ee-2efc-42a5-a92c-140b4bccd0f2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.413371 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b440ee-2efc-42a5-a92c-140b4bccd0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.433181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-30b440ee-2efc-42a5-a92c-140b4bccd0f2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:14.434400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-30b440ee-2efc-42a5-a92c-140b4bccd0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:14.506728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1226/2454] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:14.515077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046e5c4-b270-426d-bffe-0833028cf06b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.515358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046e5c4-b270-426d-bffe-0833028cf06b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.515630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046e5c4-b270-426d-bffe-0833028cf06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.536471 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6046e5c4-b270-426d-bffe-0833028cf06b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:14.537662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6046e5c4-b270-426d-bffe-0833028cf06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:14.547095 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1229/2455] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:14.551724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b440ee-2efc-42a5-a92c-140b4bccd0f2 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:14.561795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b440ee-2efc-42a5-a92c-140b4bccd0f2 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:14.568073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a12cf-209c-45e7-9836-1071d7f54036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:14.568735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a12cf-209c-45e7-9836-1071d7f54036 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.569009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a12cf-209c-45e7-9836-1071d7f54036 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.569253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a12cf-209c-45e7-9836-1071d7f54036 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.570009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a12cf-209c-45e7-9836-1071d7f54036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:03:14.570342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a12cf-209c-45e7-9836-1071d7f54036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:14.571962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a12cf-209c-45e7-9836-1071d7f54036 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:14.584642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1227/2456] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:03:14.589205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046e5c4-b270-426d-bffe-0833028cf06b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:14.599628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046e5c4-b270-426d-bffe-0833028cf06b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:14.604418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513dfa8-6e9c-477c-920f-988125b08507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:14.605065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513dfa8-6e9c-477c-920f-988125b08507 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.605345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513dfa8-6e9c-477c-920f-988125b08507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.605639 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513dfa8-6e9c-477c-920f-988125b08507 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.606378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513dfa8-6e9c-477c-920f-988125b08507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:14.608319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513dfa8-6e9c-477c-920f-988125b08507 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:14.635750 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1230/2457] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:03:14 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:03:14.640326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a12cf-209c-45e7-9836-1071d7f54036 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:14.650669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a12cf-209c-45e7-9836-1071d7f54036 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:14.712610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd01d55-a804-414c-a0a6-216099f890eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:14.713287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd01d55-a804-414c-a0a6-216099f890eb admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.713602 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd01d55-a804-414c-a0a6-216099f890eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.713834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd01d55-a804-414c-a0a6-216099f890eb admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.714557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd01d55-a804-414c-a0a6-216099f890eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:14.716820 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd01d55-a804-414c-a0a6-216099f890eb admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:14.743548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1228/2458] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:03:14 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:03:14.749114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513dfa8-6e9c-477c-920f-988125b08507 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:14.760451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513dfa8-6e9c-477c-920f-988125b08507 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:14.765307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e13528-8ccc-4db4-b804-dcbf4a36834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:14.765987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e13528-8ccc-4db4-b804-dcbf4a36834c admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.766266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e13528-8ccc-4db4-b804-dcbf4a36834c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.766539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e13528-8ccc-4db4-b804-dcbf4a36834c admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.767259 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e13528-8ccc-4db4-b804-dcbf4a36834c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:14.768854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e13528-8ccc-4db4-b804-dcbf4a36834c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:14.779591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1231/2459] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:14.783786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd01d55-a804-414c-a0a6-216099f890eb admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:14.794223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd01d55-a804-414c-a0a6-216099f890eb admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:14.799010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e3390-b6aa-47de-8a36-eeaedc9e2a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:14.799599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3390-b6aa-47de-8a36-eeaedc9e2a20 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.799883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3390-b6aa-47de-8a36-eeaedc9e2a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.800159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3390-b6aa-47de-8a36-eeaedc9e2a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.800985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e3390-b6aa-47de-8a36-eeaedc9e2a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:14.802623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e3390-b6aa-47de-8a36-eeaedc9e2a20 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:14.812412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1229/2460] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:14.816862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e13528-8ccc-4db4-b804-dcbf4a36834c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:14.827265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e13528-8ccc-4db4-b804-dcbf4a36834c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:14.834309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded1344-d625-4c06-b2fa-c55666e437fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:14.835196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1344-d625-4c06-b2fa-c55666e437fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.835466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1344-d625-4c06-b2fa-c55666e437fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.835764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1344-d625-4c06-b2fa-c55666e437fc admin admin] PATH_INFO: `/v3/projects/a622336ba673453a8102b514452d365c/users/09a544f5a95e4ed0ad9aa0cd8022b6cf/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.852969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded1344-d625-4c06-b2fa-c55666e437fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a622336ba673453a8102b514452d365c, user_id=09a544f5a95e4ed0ad9aa0cd8022b6cf, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:14.855658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded1344-d625-4c06-b2fa-c55666e437fc admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:14.874274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1232/2461] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:03:14 2022] PUT /identity/v3/projects/a622336ba673453a8102b514452d365c/users/09a544f5a95e4ed0ad9aa0cd8022b6cf/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:14.889927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9622a5-bbcb-4ab0-a5cb-407d4d3ccfac None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:14.890354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9622a5-bbcb-4ab0-a5cb-407d4d3ccfac None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:14.890756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9622a5-bbcb-4ab0-a5cb-407d4d3ccfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:14.920863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fa9622a5-bbcb-4ab0-a5cb-407d4d3ccfac None None] MFA Rules not processed for user `09a544f5a95e4ed0ad9aa0cd8022b6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:14.922123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fa9622a5-bbcb-4ab0-a5cb-407d4d3ccfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:14.985432 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1230/2462] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:14.996680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded1344-d625-4c06-b2fa-c55666e437fc admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:14.998490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8ded1344-d625-4c06-b2fa-c55666e437fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:15.054279 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded1344-d625-4c06-b2fa-c55666e437fc admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:15.058400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21289fd1-200f-46df-926e-147d6f7b7bfb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:15.059005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21289fd1-200f-46df-926e-147d6f7b7bfb service glance] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:15.059319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21289fd1-200f-46df-926e-147d6f7b7bfb service glance] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:15.059594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21289fd1-200f-46df-926e-147d6f7b7bfb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:15.068665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21289fd1-200f-46df-926e-147d6f7b7bfb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:15.070141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21289fd1-200f-46df-926e-147d6f7b7bfb service glance] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:15.082186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1233/2463] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:24.568688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9622a5-bbcb-4ab0-a5cb-407d4d3ccfac None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:24.570939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fa9622a5-bbcb-4ab0-a5cb-407d4d3ccfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:24.630237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9622a5-bbcb-4ab0-a5cb-407d4d3ccfac None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:24.634644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335d866-fd59-4ce4-a71b-300435b14f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:24.635387 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d866-fd59-4ce4-a71b-300435b14f2e service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:24.635812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d866-fd59-4ce4-a71b-300435b14f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:24.636300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d866-fd59-4ce4-a71b-300435b14f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:24.638362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d335d866-fd59-4ce4-a71b-300435b14f2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:24.706580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335d866-fd59-4ce4-a71b-300435b14f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:24.708457 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335d866-fd59-4ce4-a71b-300435b14f2e service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:24.719549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1231/2464] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:31.795131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21289fd1-200f-46df-926e-147d6f7b7bfb service glance] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:31.796654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-21289fd1-200f-46df-926e-147d6f7b7bfb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:31.814429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21289fd1-200f-46df-926e-147d6f7b7bfb service glance] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:31.820008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:31.821134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:31.822743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:31.823021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] PATH_INFO: `/v3/users/c460c594b2c845ff88dcbdc5c6ad1edc` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:31.824345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c460c594b2c845ff88dcbdc5c6ad1edc)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:31.826525 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:31.877957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c460c594b2c845ff88dcbdc5c6ad1edc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:31.878643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c460c594b2c845ff88dcbdc5c6ad1edc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:31.879247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c460c594b2c845ff88dcbdc5c6ad1edc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:31.886791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c460c594b2c845ff88dcbdc5c6ad1edc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:31.893591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c460c594b2c845ff88dcbdc5c6ad1edc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:31.911218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1234/2465] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:03:31 2022] DELETE /identity/v3/users/c460c594b2c845ff88dcbdc5c6ad1edc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:32.102025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335d866-fd59-4ce4-a71b-300435b14f2e service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:32.114313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335d866-fd59-4ce4-a71b-300435b14f2e service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:32.180046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:32.180961 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:32.181244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:32.181518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] PATH_INFO: `/v3/projects/516b7b9385894affab50793ae382b7e2` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:32.182775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=516b7b9385894affab50793ae382b7e2)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:32.184773 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:32.234805 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516b7b9385894affab50793ae382b7e2', 'request_id': 'req-31aa1fd0-7973-444c-9634-2067a4256cae'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.240226 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516b7b9385894affab50793ae382b7e2', 'request_id': 'req-31aa1fd0-7973-444c-9634-2067a4256cae'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.248910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516b7b9385894affab50793ae382b7e2', 'request_id': 'req-31aa1fd0-7973-444c-9634-2067a4256cae'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.260194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] The token cache is being invalidate because project 516b7b9385894affab50793ae382b7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:03:32.260478 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.261125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.262725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1232/2466] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:03:32 2022] DELETE /identity/v3/projects/516b7b9385894affab50793ae382b7e2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:32.267291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:32.268846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:32.283483 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3878-08c9-4a8a-ac21-9a49a3268fed admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:32.340619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:32.341513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:32.341836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:32.342164 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] PATH_INFO: `/v3/users/d34d73f6eda24d9ca604ab9c14ab0509` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:32.343607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34d73f6eda24d9ca604ab9c14ab0509)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:32.345619 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:32.398262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34d73f6eda24d9ca604ab9c14ab0509'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.398939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34d73f6eda24d9ca604ab9c14ab0509'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.399546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34d73f6eda24d9ca604ab9c14ab0509'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.407219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34d73f6eda24d9ca604ab9c14ab0509'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.414473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34d73f6eda24d9ca604ab9c14ab0509'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.431341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1235/2467] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:03:32 2022] DELETE /identity/v3/users/d34d73f6eda24d9ca604ab9c14ab0509 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:32.615596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:32.617283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:32.632505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa1fd0-7973-444c-9634-2067a4256cae admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:32.688941 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:32.689853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:32.690165 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:32.690441 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] PATH_INFO: `/v3/projects/c05aeb90e99a4d7584808e08b956030b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:32.691626 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05aeb90e99a4d7584808e08b956030b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:32.693740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:32.741967 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05aeb90e99a4d7584808e08b956030b', 'request_id': 'req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.747957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05aeb90e99a4d7584808e08b956030b', 'request_id': 'req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.757087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05aeb90e99a4d7584808e08b956030b', 'request_id': 'req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.768154 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] The token cache is being invalidate because project c05aeb90e99a4d7584808e08b956030b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:03:32.768424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.769073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b015d4b6-3646-48f3-bc2d-49f0ed2e5161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:32.770879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1233/2468] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:03:32 2022] DELETE /identity/v3/projects/c05aeb90e99a4d7584808e08b956030b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:44.504204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:44.506074 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:44.520770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0fdfa-e294-407e-ad31-ea79392daca0 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:44.580981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:44.581891 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:44.582269 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:44.582546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] PATH_INFO: `/v3/users/09a544f5a95e4ed0ad9aa0cd8022b6cf` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:44.583913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a544f5a95e4ed0ad9aa0cd8022b6cf)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:44.585842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:44.637586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a544f5a95e4ed0ad9aa0cd8022b6cf'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:44.638286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a544f5a95e4ed0ad9aa0cd8022b6cf'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:44.638857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a544f5a95e4ed0ad9aa0cd8022b6cf'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:44.655591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a544f5a95e4ed0ad9aa0cd8022b6cf'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:44.662694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a544f5a95e4ed0ad9aa0cd8022b6cf'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:44.680244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1236/2469] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:03:44 2022] DELETE /identity/v3/users/09a544f5a95e4ed0ad9aa0cd8022b6cf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:03:44.684872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387895b-1d08-4cc7-b6a3-ea34014d572e None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:44.685355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387895b-1d08-4cc7-b6a3-ea34014d572e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:44.685438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387895b-1d08-4cc7-b6a3-ea34014d572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:44.702766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-1387895b-1d08-4cc7-b6a3-ea34014d572e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:44.703973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1387895b-1d08-4cc7-b6a3-ea34014d572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:44.768186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1234/2470] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:44.806083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:44.807627 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:44.866897 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26f166-91c3-4e02-8e54-07a37eb9e589 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:44.870944 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c5219-a327-4511-8162-100958265d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:44.871681 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c5219-a327-4511-8162-100958265d71 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:44.871987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c5219-a327-4511-8162-100958265d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:44.872264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c5219-a327-4511-8162-100958265d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:44.883758 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c5219-a327-4511-8162-100958265d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:44.885221 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c5219-a327-4511-8162-100958265d71 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:44.896654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1237/2471] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:45.450199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387895b-1d08-4cc7-b6a3-ea34014d572e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:45.451837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1387895b-1d08-4cc7-b6a3-ea34014d572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:45.464806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387895b-1d08-4cc7-b6a3-ea34014d572e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:45.471705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:45.473010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:45.473010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:45.473209 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] PATH_INFO: `/v3/projects/a622336ba673453a8102b514452d365c` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:45.474495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a622336ba673453a8102b514452d365c)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:45.476429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:45.525606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a622336ba673453a8102b514452d365c', 'request_id': 'req-a31df5ea-2f98-47d7-8f4f-762356951fb6'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:45.531151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a622336ba673453a8102b514452d365c', 'request_id': 'req-a31df5ea-2f98-47d7-8f4f-762356951fb6'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:45.539144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a622336ba673453a8102b514452d365c', 'request_id': 'req-a31df5ea-2f98-47d7-8f4f-762356951fb6'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:45.550661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] The token cache is being invalidate because project a622336ba673453a8102b514452d365c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:03:45.551056 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:45.551691 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a31df5ea-2f98-47d7-8f4f-762356951fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:45.553350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1235/2472] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:03:45 2022] DELETE /identity/v3/projects/a622336ba673453a8102b514452d365c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:45.558455 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24900f-afc5-4c55-8e72-a694cdeb2d85 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:45.558993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24900f-afc5-4c55-8e72-a694cdeb2d85 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:45.559079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24900f-afc5-4c55-8e72-a694cdeb2d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:45.578311 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-eb24900f-afc5-4c55-8e72-a694cdeb2d85 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:45.579532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-eb24900f-afc5-4c55-8e72-a694cdeb2d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:45.650981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1238/2473] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:45.660152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7409f-df10-4859-9536-1324acc9b8f6 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:45.660536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7409f-df10-4859-9536-1324acc9b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:45.661019 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7409f-df10-4859-9536-1324acc9b8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:45.687813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-dbd7409f-df10-4859-9536-1324acc9b8f6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:45.689040 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-dbd7409f-df10-4859-9536-1324acc9b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:45.705362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1236/2474] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:45.711652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24900f-afc5-4c55-8e72-a694cdeb2d85 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:45.722816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24900f-afc5-4c55-8e72-a694cdeb2d85 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:45.729055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded7105-0d23-4262-a671-a2b88761135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:45.729727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded7105-0d23-4262-a671-a2b88761135b admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:45.730038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded7105-0d23-4262-a671-a2b88761135b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:45.730337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded7105-0d23-4262-a671-a2b88761135b admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:45.731097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded7105-0d23-4262-a671-a2b88761135b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:03:45.731401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded7105-0d23-4262-a671-a2b88761135b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:45.733084 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded7105-0d23-4262-a671-a2b88761135b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:45.746234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1239/2475] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 20:03:45.750446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7409f-df10-4859-9536-1324acc9b8f6 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:45.760306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7409f-df10-4859-9536-1324acc9b8f6 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:45.765415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096257a8-85a5-4af1-9d15-9b25b3c1bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:45.766207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096257a8-85a5-4af1-9d15-9b25b3c1bcdb admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:45.766491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096257a8-85a5-4af1-9d15-9b25b3c1bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:45.766777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096257a8-85a5-4af1-9d15-9b25b3c1bcdb admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:45.767454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096257a8-85a5-4af1-9d15-9b25b3c1bcdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:45.769482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096257a8-85a5-4af1-9d15-9b25b3c1bcdb admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:45.800218 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1237/2476] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:03:45 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:03:45.804849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded7105-0d23-4262-a671-a2b88761135b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:45.816686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded7105-0d23-4262-a671-a2b88761135b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:45.873848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd0388-e5bc-447e-b655-c1a0a1035962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:45.874584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd0388-e5bc-447e-b655-c1a0a1035962 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:45.874929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd0388-e5bc-447e-b655-c1a0a1035962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:45.875203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd0388-e5bc-447e-b655-c1a0a1035962 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:45.875927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd0388-e5bc-447e-b655-c1a0a1035962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:45.877928 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd0388-e5bc-447e-b655-c1a0a1035962 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:45.903222 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1240/2477] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:03:45 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:03:45.903636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096257a8-85a5-4af1-9d15-9b25b3c1bcdb admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:45.914592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096257a8-85a5-4af1-9d15-9b25b3c1bcdb admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:45.919999 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3138003-84fd-4c68-bd5a-bff4e27984ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:45.920790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3138003-84fd-4c68-bd5a-bff4e27984ca admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:45.921160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3138003-84fd-4c68-bd5a-bff4e27984ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:45.921503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3138003-84fd-4c68-bd5a-bff4e27984ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:45.922424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3138003-84fd-4c68-bd5a-bff4e27984ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:45.924229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3138003-84fd-4c68-bd5a-bff4e27984ca admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:45.937098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1238/2478] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:45.941006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd0388-e5bc-447e-b655-c1a0a1035962 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:45.951454 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd0388-e5bc-447e-b655-c1a0a1035962 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:45.956513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ca501-09b5-4de9-aa36-e1800f08ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:45.957265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ca501-09b5-4de9-aa36-e1800f08ecc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:45.957618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ca501-09b5-4de9-aa36-e1800f08ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:45.958054 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ca501-09b5-4de9-aa36-e1800f08ecc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:45.958859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ca501-09b5-4de9-aa36-e1800f08ecc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:45.960572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ca501-09b5-4de9-aa36-e1800f08ecc9 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:45.971770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1241/2479] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:03:45.976236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3138003-84fd-4c68-bd5a-bff4e27984ca admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:45.989394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3138003-84fd-4c68-bd5a-bff4e27984ca admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:45.995538 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212fd09-9e3d-46e9-9fc2-add663220227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:45.996426 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212fd09-9e3d-46e9-9fc2-add663220227 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:45.996841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212fd09-9e3d-46e9-9fc2-add663220227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:45.997121 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212fd09-9e3d-46e9-9fc2-add663220227 admin admin] PATH_INFO: `/v3/projects/0c3dc2a6ad1c4f2b9f596beb9dd21873/users/351e57defe0947a785e67070e1048f67/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:46.015158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212fd09-9e3d-46e9-9fc2-add663220227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3dc2a6ad1c4f2b9f596beb9dd21873, user_id=351e57defe0947a785e67070e1048f67, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:46.018157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212fd09-9e3d-46e9-9fc2-add663220227 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:46.036144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1239/2480] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:03:45 2022] PUT /identity/v3/projects/0c3dc2a6ad1c4f2b9f596beb9dd21873/users/351e57defe0947a785e67070e1048f67/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:46.046868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e0cff-7fed-4292-83ba-d5cd6836f510 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:46.047162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e0cff-7fed-4292-83ba-d5cd6836f510 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:46.047447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e0cff-7fed-4292-83ba-d5cd6836f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:46.076161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1a2e0cff-7fed-4292-83ba-d5cd6836f510 None None] MFA Rules not processed for user `351e57defe0947a785e67070e1048f67`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:46.077411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1a2e0cff-7fed-4292-83ba-d5cd6836f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:46.141707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1242/2481] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:46.152564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212fd09-9e3d-46e9-9fc2-add663220227 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:46.154321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b212fd09-9e3d-46e9-9fc2-add663220227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:46.212215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212fd09-9e3d-46e9-9fc2-add663220227 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:46.216613 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3505d-3e63-4d2e-9b5a-3ea35992d8f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:46.217365 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3505d-3e63-4d2e-9b5a-3ea35992d8f4 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:46.217636 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3505d-3e63-4d2e-9b5a-3ea35992d8f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:46.217971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3505d-3e63-4d2e-9b5a-3ea35992d8f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:46.226871 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3505d-3e63-4d2e-9b5a-3ea35992d8f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:46.228545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3505d-3e63-4d2e-9b5a-3ea35992d8f4 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:46.237719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1240/2482] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:46.875320 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645cdd9-bc4d-4f86-ad86-e0c371ae7bc3 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:46.875896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645cdd9-bc4d-4f86-ad86-e0c371ae7bc3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:46.875896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645cdd9-bc4d-4f86-ad86-e0c371ae7bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:46.916554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d645cdd9-bc4d-4f86-ad86-e0c371ae7bc3 None None] MFA Rules not processed for user `9680269cd8504c36b6027040e185a817`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:46.917748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d645cdd9-bc4d-4f86-ad86-e0c371ae7bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:46.976201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1243/2483] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:03:47.316436 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3505d-3e63-4d2e-9b5a-3ea35992d8f4 service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:47.318667 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0cb3505d-3e63-4d2e-9b5a-3ea35992d8f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:47.381651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3505d-3e63-4d2e-9b5a-3ea35992d8f4 service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:47.388115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7af38-3de1-4831-a563-6450f0110486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:47.388781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7af38-3de1-4831-a563-6450f0110486 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:47.389059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7af38-3de1-4831-a563-6450f0110486 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:47.389325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7af38-3de1-4831-a563-6450f0110486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:47.391769 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-23b7af38-3de1-4831-a563-6450f0110486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:47.403970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7af38-3de1-4831-a563-6450f0110486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:47.405415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7af38-3de1-4831-a563-6450f0110486 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:47.414345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1241/2484] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:49.289760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645cdd9-bc4d-4f86-ad86-e0c371ae7bc3 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:49.356553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645cdd9-bc4d-4f86-ad86-e0c371ae7bc3 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:49.362407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:49.363346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:49.363626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:49.363892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] PATH_INFO: `/v3/users/351e57defe0947a785e67070e1048f67` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:49.365589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=351e57defe0947a785e67070e1048f67)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:49.367684 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:49.420787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351e57defe0947a785e67070e1048f67'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:49.421491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351e57defe0947a785e67070e1048f67'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:49.422189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351e57defe0947a785e67070e1048f67'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:49.431434 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351e57defe0947a785e67070e1048f67'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:49.438898 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351e57defe0947a785e67070e1048f67'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:49.456482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1244/2485] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:03:49 2022] DELETE /identity/v3/users/351e57defe0947a785e67070e1048f67 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:49.461081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5734ee-21b0-4862-98fa-fb156d7016b5 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:49.461584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5734ee-21b0-4862-98fa-fb156d7016b5 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:49.461873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5734ee-21b0-4862-98fa-fb156d7016b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:49.480935 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4b5734ee-21b0-4862-98fa-fb156d7016b5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:03:49.482202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4b5734ee-21b0-4862-98fa-fb156d7016b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:49.544508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1242/2486] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:03:49.554152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:49.555550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:49.617025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a13059-0a9e-4b44-8dbc-fa2fcf46e7b4 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:49.621797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c60f7-6d7b-44ff-82aa-49595974489a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:49.623097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c60f7-6d7b-44ff-82aa-49595974489a service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:49.623097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c60f7-6d7b-44ff-82aa-49595974489a service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:49.623312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c60f7-6d7b-44ff-82aa-49595974489a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:49.635170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c60f7-6d7b-44ff-82aa-49595974489a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:49.636798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c60f7-6d7b-44ff-82aa-49595974489a service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:49.648061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1245/2487] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:50.146358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5734ee-21b0-4862-98fa-fb156d7016b5 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:50.147831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4b5734ee-21b0-4862-98fa-fb156d7016b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:50.161130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5734ee-21b0-4862-98fa-fb156d7016b5 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:50.167108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:50.168018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:50.168323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:50.168597 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] PATH_INFO: `/v3/projects/0c3dc2a6ad1c4f2b9f596beb9dd21873` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:50.169964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c3dc2a6ad1c4f2b9f596beb9dd21873)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:50.171985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:50.227082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c3dc2a6ad1c4f2b9f596beb9dd21873', 'request_id': 'req-5f22dab6-adac-44c0-b761-f41c89c15ade'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:50.233167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c3dc2a6ad1c4f2b9f596beb9dd21873', 'request_id': 'req-5f22dab6-adac-44c0-b761-f41c89c15ade'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:50.241656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c3dc2a6ad1c4f2b9f596beb9dd21873', 'request_id': 'req-5f22dab6-adac-44c0-b761-f41c89c15ade'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:50.254750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] The token cache is being invalidate because project 0c3dc2a6ad1c4f2b9f596beb9dd21873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:03:50.255036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:50.255695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:03:50.257262 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1243/2488] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:03:50 2022] DELETE /identity/v3/projects/0c3dc2a6ad1c4f2b9f596beb9dd21873 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:03:52.559689 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c60f7-6d7b-44ff-82aa-49595974489a service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:52.573690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c60f7-6d7b-44ff-82aa-49595974489a service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:52.637852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2d5c0-f34b-434d-90ea-2df9afedf775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:52.638586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2d5c0-f34b-434d-90ea-2df9afedf775 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:52.638888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2d5c0-f34b-434d-90ea-2df9afedf775 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:52.639158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2d5c0-f34b-434d-90ea-2df9afedf775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:52.641449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c1f2d5c0-f34b-434d-90ea-2df9afedf775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:52.728338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2d5c0-f34b-434d-90ea-2df9afedf775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:52.730536 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2d5c0-f34b-434d-90ea-2df9afedf775 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:52.750003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1246/2489] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:03:53.942319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:03:53.943916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:53.957624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22dab6-adac-44c0-b761-f41c89c15ade admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:03:53.962414 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6f76c-a2bc-49bd-8703-861fc4e0dbef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:03:53.963065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6f76c-a2bc-49bd-8703-861fc4e0dbef service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:03:53.963344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6f76c-a2bc-49bd-8703-861fc4e0dbef service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:03:53.963614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6f76c-a2bc-49bd-8703-861fc4e0dbef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:03:53.966011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5dd6f76c-a2bc-49bd-8703-861fc4e0dbef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:03:53.980994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6f76c-a2bc-49bd-8703-861fc4e0dbef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:03:53.982489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6f76c-a2bc-49bd-8703-861fc4e0dbef service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:03:53.994232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1244/2490] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:03:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:04:42.242337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2d5c0-f34b-434d-90ea-2df9afedf775 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:04:42.251574 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2d5c0-f34b-434d-90ea-2df9afedf775 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:04:42.255356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:04:42.255991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:04:42.256299 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:04:42.256573 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:04:42.258542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:04:42.269664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:04:42.271134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:04:42.279931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1247/2491] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:04:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:04:54.526207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6baed2-30cc-4568-b6a3-2c9d20de204c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:04:54.526771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6baed2-30cc-4568-b6a3-2c9d20de204c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:04:54.527172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6baed2-30cc-4568-b6a3-2c9d20de204c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:04:54.547237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fe6baed2-30cc-4568-b6a3-2c9d20de204c None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:04:54.548464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fe6baed2-30cc-4568-b6a3-2c9d20de204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:04:54.604046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1245/2492] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:04:54.659011 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:04:54.660755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:04:54.765018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053e2a6-2dc2-4fdb-8c57-278a1e84fd12 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:04:54.770055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cc38-dc57-477f-87f2-1ae2cf4bd45c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:04:54.770708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cc38-dc57-477f-87f2-1ae2cf4bd45c service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:04:54.771023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cc38-dc57-477f-87f2-1ae2cf4bd45c service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:04:54.771294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cc38-dc57-477f-87f2-1ae2cf4bd45c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:04:54.780693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65cc38-dc57-477f-87f2-1ae2cf4bd45c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:04:54.782416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65cc38-dc57-477f-87f2-1ae2cf4bd45c service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:04:54.792223 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1248/2493] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:04:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:05:09.959624 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6baed2-30cc-4568-b6a3-2c9d20de204c None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:09.961213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fe6baed2-30cc-4568-b6a3-2c9d20de204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:09.978901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6baed2-30cc-4568-b6a3-2c9d20de204c None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:09.985167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:09.985819 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:09.986129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:09.986396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:09.988207 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:10.000826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:10.002474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:10.013913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1246/2494] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:11.346329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cc38-dc57-477f-87f2-1ae2cf4bd45c service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:11.347816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9e65cc38-dc57-477f-87f2-1ae2cf4bd45c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:11.407274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cc38-dc57-477f-87f2-1ae2cf4bd45c service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:11.411008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9ada-ec87-4ea0-ba65-3a01dcce16df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:11.411668 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9ada-ec87-4ea0-ba65-3a01dcce16df service glance] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:11.411949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9ada-ec87-4ea0-ba65-3a01dcce16df service glance] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:11.412217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9ada-ec87-4ea0-ba65-3a01dcce16df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:11.414136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5b2b9ada-ec87-4ea0-ba65-3a01dcce16df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:11.428371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9ada-ec87-4ea0-ba65-3a01dcce16df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:11.429828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9ada-ec87-4ea0-ba65-3a01dcce16df service glance] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:11.441163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1249/2495] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:11.510841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:11.513085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:11.527137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466f165-a910-4e9e-8ab6-c9ac24f3b93c service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:11.531313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:11.531965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:11.532239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:11.532515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:11.534282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:11.544103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:11.545565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:11.553588 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1247/2496] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:05:12.651094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9ada-ec87-4ea0-ba65-3a01dcce16df service glance] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:12.661229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9ada-ec87-4ea0-ba65-3a01dcce16df service glance] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:12.666060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:12.666714 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:12.666990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:12.667292 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:12.669974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:12.685195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:12.686703 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:12.697650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1250/2497] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:12.823039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:12.825610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:12.898625 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66358-06c4-4ea3-b8a7-88689a076cba service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:12.904579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1717f3a-6bca-4ee9-963f-db3c3330003f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:12.905251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1717f3a-6bca-4ee9-963f-db3c3330003f service placement] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:12.905534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1717f3a-6bca-4ee9-963f-db3c3330003f service placement] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:12.905818 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1717f3a-6bca-4ee9-963f-db3c3330003f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:12.907724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a1717f3a-6bca-4ee9-963f-db3c3330003f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:12.920000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1717f3a-6bca-4ee9-963f-db3c3330003f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:12.921604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1717f3a-6bca-4ee9-963f-db3c3330003f service placement] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:12.931821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1248/2498] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:13.257044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:13.259429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:13.277540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e2b63-fae7-4b79-8f6e-1272c785d152 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:13.290252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71813a-55fe-47aa-921e-58da0f7c8019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:13.291329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71813a-55fe-47aa-921e-58da0f7c8019 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:13.291709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71813a-55fe-47aa-921e-58da0f7c8019 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:13.292082 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71813a-55fe-47aa-921e-58da0f7c8019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:13.295292 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1a71813a-55fe-47aa-921e-58da0f7c8019 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:13.309724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71813a-55fe-47aa-921e-58da0f7c8019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:13.312000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71813a-55fe-47aa-921e-58da0f7c8019 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:13.326226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1251/2499] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:17.686972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be270b-33e5-46af-a5dd-72f5de5b7efd None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:17.687502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be270b-33e5-46af-a5dd-72f5de5b7efd None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:17.687502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be270b-33e5-46af-a5dd-72f5de5b7efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:17.706991 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a4be270b-33e5-46af-a5dd-72f5de5b7efd None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:17.708185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a4be270b-33e5-46af-a5dd-72f5de5b7efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:17.716808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1249/2500] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:17.732695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71813a-55fe-47aa-921e-58da0f7c8019 service nova] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:17.749091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71813a-55fe-47aa-921e-58da0f7c8019 service nova] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:17.754812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5201c-5fae-4621-abfa-d78850a7479d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:17.755445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5201c-5fae-4621-abfa-d78850a7479d service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:17.755723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5201c-5fae-4621-abfa-d78850a7479d service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:17.756003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5201c-5fae-4621-abfa-d78850a7479d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:17.764522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5201c-5fae-4621-abfa-d78850a7479d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:17.766142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5201c-5fae-4621-abfa-d78850a7479d service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:17.774057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1252/2501] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:05:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:05:18.690125 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be270b-33e5-46af-a5dd-72f5de5b7efd None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:18.701929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be270b-33e5-46af-a5dd-72f5de5b7efd None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:18.705913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6f146-1654-4f2d-8036-7b033324aada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:18.706679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6f146-1654-4f2d-8036-7b033324aada service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:18.707020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6f146-1654-4f2d-8036-7b033324aada service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:18.707350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6f146-1654-4f2d-8036-7b033324aada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:18.709197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5eb6f146-1654-4f2d-8036-7b033324aada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:18.812098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6f146-1654-4f2d-8036-7b033324aada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:18.813579 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6f146-1654-4f2d-8036-7b033324aada service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:18.828891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1250/2502] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:23.208993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5201c-5fae-4621-abfa-d78850a7479d service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:23.211241 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c1a5201c-5fae-4621-abfa-d78850a7479d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:23.227923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5201c-5fae-4621-abfa-d78850a7479d service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:23.233060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:23.234413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:23.234741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:23.235054 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] PATH_INFO: `/v3/users/3763d1d3f1cd46058e1979062d084de5` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:23.251448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3763d1d3f1cd46058e1979062d084de5)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:23.253575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:23.304789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3763d1d3f1cd46058e1979062d084de5'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.305743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3763d1d3f1cd46058e1979062d084de5'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.306385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3763d1d3f1cd46058e1979062d084de5'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.314339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3763d1d3f1cd46058e1979062d084de5'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.321811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b37bbd7f-6a5e-48c4-b835-ef584f7b46ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3763d1d3f1cd46058e1979062d084de5'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.342495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1253/2503] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:05:23 2022] DELETE /identity/v3/users/3763d1d3f1cd46058e1979062d084de5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:23.533071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6f146-1654-4f2d-8036-7b033324aada service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:23.553723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6f146-1654-4f2d-8036-7b033324aada service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:23.627367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:23.628310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:23.628593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:23.628872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] PATH_INFO: `/v3/projects/315085e770ff482b82cc030c63c7edab` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:23.640383 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=315085e770ff482b82cc030c63c7edab)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:23.642351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:23.703538 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315085e770ff482b82cc030c63c7edab', 'request_id': 'req-b5c2da63-0501-4321-8ec5-64b22f448fb5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.709188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315085e770ff482b82cc030c63c7edab', 'request_id': 'req-b5c2da63-0501-4321-8ec5-64b22f448fb5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.718189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315085e770ff482b82cc030c63c7edab', 'request_id': 'req-b5c2da63-0501-4321-8ec5-64b22f448fb5'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.730813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] The token cache is being invalidate because project 315085e770ff482b82cc030c63c7edab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:05:23.731099 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.732069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b5c2da63-0501-4321-8ec5-64b22f448fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:23.733745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1251/2504] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:05:23 2022] DELETE /identity/v3/projects/315085e770ff482b82cc030c63c7edab => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:23.738979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ffd4-fd3c-4fb3-b1e9-25d195b28bec None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:23.739265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ffd4-fd3c-4fb3-b1e9-25d195b28bec None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:23.739537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ffd4-fd3c-4fb3-b1e9-25d195b28bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:23.760654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-3b80ffd4-fd3c-4fb3-b1e9-25d195b28bec None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:23.762125 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3b80ffd4-fd3c-4fb3-b1e9-25d195b28bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:23.864843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1254/2505] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:05:23.872756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb8555-cc83-4f6c-bbf6-dd85e17be92b None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:23.873509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb8555-cc83-4f6c-bbf6-dd85e17be92b None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:23.873849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb8555-cc83-4f6c-bbf6-dd85e17be92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:23.899179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-feeb8555-cc83-4f6c-bbf6-dd85e17be92b None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:23.900824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-feeb8555-cc83-4f6c-bbf6-dd85e17be92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:23.913705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1252/2506] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:23.924763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80ffd4-fd3c-4fb3-b1e9-25d195b28bec None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:23.946061 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80ffd4-fd3c-4fb3-b1e9-25d195b28bec None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:23.959409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25efa76-a1f8-4604-b45c-c8b25dbb4f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:23.960264 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efa76-a1f8-4604-b45c-c8b25dbb4f92 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:23.960550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efa76-a1f8-4604-b45c-c8b25dbb4f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:23.960823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25efa76-a1f8-4604-b45c-c8b25dbb4f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:23.961711 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25efa76-a1f8-4604-b45c-c8b25dbb4f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:05:23.962050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25efa76-a1f8-4604-b45c-c8b25dbb4f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:23.964009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25efa76-a1f8-4604-b45c-c8b25dbb4f92 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:23.979208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1255/2507] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:05:23.984070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb8555-cc83-4f6c-bbf6-dd85e17be92b None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:23.994728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb8555-cc83-4f6c-bbf6-dd85e17be92b None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:24.000190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f889819-cbce-4120-bbd5-d97879dbd64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:24.000549 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f889819-cbce-4120-bbd5-d97879dbd64f admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:24.000724 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f889819-cbce-4120-bbd5-d97879dbd64f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:24.001007 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f889819-cbce-4120-bbd5-d97879dbd64f admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:24.001720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f889819-cbce-4120-bbd5-d97879dbd64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:24.004008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f889819-cbce-4120-bbd5-d97879dbd64f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:24.040413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1253/2508] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:23 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:05:24.042024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25efa76-a1f8-4604-b45c-c8b25dbb4f92 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:24.052648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25efa76-a1f8-4604-b45c-c8b25dbb4f92 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:24.116743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175d9e9-9ae5-4e34-9755-6ab3a4357b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:24.117831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175d9e9-9ae5-4e34-9755-6ab3a4357b6f admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:24.118316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175d9e9-9ae5-4e34-9755-6ab3a4357b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:24.118748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175d9e9-9ae5-4e34-9755-6ab3a4357b6f admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:24.119606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175d9e9-9ae5-4e34-9755-6ab3a4357b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:24.121682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175d9e9-9ae5-4e34-9755-6ab3a4357b6f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:24.143594 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1256/2509] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:24 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:24.147869 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f889819-cbce-4120-bbd5-d97879dbd64f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:24.159456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f889819-cbce-4120-bbd5-d97879dbd64f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:24.164714 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236740f-9d82-4028-9a62-2f4bb9feeb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:24.165558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236740f-9d82-4028-9a62-2f4bb9feeb78 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:24.165828 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236740f-9d82-4028-9a62-2f4bb9feeb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:24.166807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236740f-9d82-4028-9a62-2f4bb9feeb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:24.167021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236740f-9d82-4028-9a62-2f4bb9feeb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:24.168721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236740f-9d82-4028-9a62-2f4bb9feeb78 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:24.180195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1254/2510] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:24.184541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175d9e9-9ae5-4e34-9755-6ab3a4357b6f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:24.194901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175d9e9-9ae5-4e34-9755-6ab3a4357b6f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:24.199493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27b1cf-5022-4dce-afe9-da9bbdec0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:24.200200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b1cf-5022-4dce-afe9-da9bbdec0ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:24.200525 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b1cf-5022-4dce-afe9-da9bbdec0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:24.200736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27b1cf-5022-4dce-afe9-da9bbdec0ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:24.201459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27b1cf-5022-4dce-afe9-da9bbdec0ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:24.203092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27b1cf-5022-4dce-afe9-da9bbdec0ac2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:24.213615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1257/2511] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:24.218299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236740f-9d82-4028-9a62-2f4bb9feeb78 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:24.229178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236740f-9d82-4028-9a62-2f4bb9feeb78 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:24.235098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69203ad-3ed0-4bc1-8eb1-49692136757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:24.235992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69203ad-3ed0-4bc1-8eb1-49692136757f admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:24.236271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69203ad-3ed0-4bc1-8eb1-49692136757f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:24.236541 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69203ad-3ed0-4bc1-8eb1-49692136757f admin admin] PATH_INFO: `/v3/projects/be45dd368fec4a84ac6463c5762e9b29/users/04fe405cff2d4ca6a4689612578c30eb/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:24.254662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69203ad-3ed0-4bc1-8eb1-49692136757f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be45dd368fec4a84ac6463c5762e9b29, user_id=04fe405cff2d4ca6a4689612578c30eb, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:24.258696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69203ad-3ed0-4bc1-8eb1-49692136757f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:24.277323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1255/2512] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:24 2022] PUT /identity/v3/projects/be45dd368fec4a84ac6463c5762e9b29/users/04fe405cff2d4ca6a4689612578c30eb/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:24.290380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35a1de-183c-49c0-8a4e-74275dad2426 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:24.290667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35a1de-183c-49c0-8a4e-74275dad2426 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:24.291149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35a1de-183c-49c0-8a4e-74275dad2426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:24.321427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-0a35a1de-183c-49c0-8a4e-74275dad2426 None None] MFA Rules not processed for user `04fe405cff2d4ca6a4689612578c30eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:24.322610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0a35a1de-183c-49c0-8a4e-74275dad2426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:24.402310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1258/2513] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:24.413662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69203ad-3ed0-4bc1-8eb1-49692136757f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:24.415683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a69203ad-3ed0-4bc1-8eb1-49692136757f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:24.503174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69203ad-3ed0-4bc1-8eb1-49692136757f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:24.509307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cdb1a-89c0-4dbb-a6b5-f699ed56d206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:24.510158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdb1a-89c0-4dbb-a6b5-f699ed56d206 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:24.510399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdb1a-89c0-4dbb-a6b5-f699ed56d206 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:24.510822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdb1a-89c0-4dbb-a6b5-f699ed56d206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:24.523480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cdb1a-89c0-4dbb-a6b5-f699ed56d206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:24.525103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cdb1a-89c0-4dbb-a6b5-f699ed56d206 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:24.534956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1256/2514] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:37.200239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35a1de-183c-49c0-8a4e-74275dad2426 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:37.265110 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35a1de-183c-49c0-8a4e-74275dad2426 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:37.270042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:37.271387 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:37.271799 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:37.272216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] PATH_INFO: `/v3/users/04fe405cff2d4ca6a4689612578c30eb` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:37.274220 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fe405cff2d4ca6a4689612578c30eb)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:37.277056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:37.327567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fe405cff2d4ca6a4689612578c30eb'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:37.328362 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fe405cff2d4ca6a4689612578c30eb'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:37.329145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fe405cff2d4ca6a4689612578c30eb'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:37.338469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fe405cff2d4ca6a4689612578c30eb'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:37.351250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fe405cff2d4ca6a4689612578c30eb'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:37.379161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1259/2515] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:05:37 2022] DELETE /identity/v3/users/04fe405cff2d4ca6a4689612578c30eb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:37.384000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801cec-854f-4b9b-a71d-a42dbf08416c None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:37.384678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801cec-854f-4b9b-a71d-a42dbf08416c None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:37.384678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801cec-854f-4b9b-a71d-a42dbf08416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:37.404004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-24801cec-854f-4b9b-a71d-a42dbf08416c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:37.405237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-24801cec-854f-4b9b-a71d-a42dbf08416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:37.466761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1257/2516] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:05:37.482104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:37.483947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:37.547645 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f6133-10eb-43dd-9717-1951b3cd7450 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:37.551816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c07f2-483a-457b-84d9-ae5091aab0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:37.552451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c07f2-483a-457b-84d9-ae5091aab0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:37.552736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c07f2-483a-457b-84d9-ae5091aab0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:37.553048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c07f2-483a-457b-84d9-ae5091aab0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:37.562925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c07f2-483a-457b-84d9-ae5091aab0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:37.564364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c07f2-483a-457b-84d9-ae5091aab0a6 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:37.574408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1260/2517] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:37.850877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24801cec-854f-4b9b-a71d-a42dbf08416c None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:37.852545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-24801cec-854f-4b9b-a71d-a42dbf08416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:37.935370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24801cec-854f-4b9b-a71d-a42dbf08416c None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:37.940894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:37.941796 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:37.942637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:37.942637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] PATH_INFO: `/v3/projects/be45dd368fec4a84ac6463c5762e9b29` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:37.943664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be45dd368fec4a84ac6463c5762e9b29)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:37.945593 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.002914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be45dd368fec4a84ac6463c5762e9b29', 'request_id': 'req-137a2469-8583-449f-92a3-d59f8c1eda80'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:38.009570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be45dd368fec4a84ac6463c5762e9b29', 'request_id': 'req-137a2469-8583-449f-92a3-d59f8c1eda80'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:38.018029 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be45dd368fec4a84ac6463c5762e9b29', 'request_id': 'req-137a2469-8583-449f-92a3-d59f8c1eda80'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:38.029779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] The token cache is being invalidate because project be45dd368fec4a84ac6463c5762e9b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:05:38.030114 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:38.030797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-137a2469-8583-449f-92a3-d59f8c1eda80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:38.032711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1258/2518] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:05:37 2022] DELETE /identity/v3/projects/be45dd368fec4a84ac6463c5762e9b29 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:38.037711 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0975f-e65f-486d-a685-d370db744463 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.038021 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0975f-e65f-486d-a685-d370db744463 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.038332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0975f-e65f-486d-a685-d370db744463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.059998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-50a0975f-e65f-486d-a685-d370db744463 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:38.061433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-50a0975f-e65f-486d-a685-d370db744463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:38.130031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1261/2519] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:38.137888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be2aa7-725d-4267-b0b1-b3ce6632843f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.138208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be2aa7-725d-4267-b0b1-b3ce6632843f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.138489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be2aa7-725d-4267-b0b1-b3ce6632843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.156560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-b4be2aa7-725d-4267-b0b1-b3ce6632843f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:38.157779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b4be2aa7-725d-4267-b0b1-b3ce6632843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:38.167312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1259/2520] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:38.172315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0975f-e65f-486d-a685-d370db744463 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.182542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0975f-e65f-486d-a685-d370db744463 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.188489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faf0b0-d8b0-4a85-beb9-ba0a65378805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.189096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faf0b0-d8b0-4a85-beb9-ba0a65378805 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.189373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faf0b0-d8b0-4a85-beb9-ba0a65378805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.189643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faf0b0-d8b0-4a85-beb9-ba0a65378805 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.190399 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faf0b0-d8b0-4a85-beb9-ba0a65378805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:05:38.190721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faf0b0-d8b0-4a85-beb9-ba0a65378805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.192320 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faf0b0-d8b0-4a85-beb9-ba0a65378805 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.204892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1262/2521] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:05:38.209873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be2aa7-725d-4267-b0b1-b3ce6632843f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.220292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be2aa7-725d-4267-b0b1-b3ce6632843f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.225134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a17d4-b090-4e51-8636-b314a731f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.225792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a17d4-b090-4e51-8636-b314a731f1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.226103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a17d4-b090-4e51-8636-b314a731f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.226382 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a17d4-b090-4e51-8636-b314a731f1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.227076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a17d4-b090-4e51-8636-b314a731f1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.228982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a17d4-b090-4e51-8636-b314a731f1e1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.260394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1260/2522] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:38 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:38.261549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faf0b0-d8b0-4a85-beb9-ba0a65378805 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.272136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faf0b0-d8b0-4a85-beb9-ba0a65378805 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.332228 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f34e26-0114-4e8f-95fe-758f2ce8757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.332905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f34e26-0114-4e8f-95fe-758f2ce8757f admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.333187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f34e26-0114-4e8f-95fe-758f2ce8757f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.333463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f34e26-0114-4e8f-95fe-758f2ce8757f admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.334229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f34e26-0114-4e8f-95fe-758f2ce8757f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.336407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f34e26-0114-4e8f-95fe-758f2ce8757f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.361505 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1263/2523] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:38 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:05:38.363560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a17d4-b090-4e51-8636-b314a731f1e1 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.374378 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a17d4-b090-4e51-8636-b314a731f1e1 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.379206 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c9bc5-a549-428d-9a8f-aecb76feac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.380285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c9bc5-a549-428d-9a8f-aecb76feac49 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.380575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c9bc5-a549-428d-9a8f-aecb76feac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.380852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c9bc5-a549-428d-9a8f-aecb76feac49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.381608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c9bc5-a549-428d-9a8f-aecb76feac49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.383279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c9bc5-a549-428d-9a8f-aecb76feac49 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.395046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1261/2524] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:38.399306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f34e26-0114-4e8f-95fe-758f2ce8757f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.409875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f34e26-0114-4e8f-95fe-758f2ce8757f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.415743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b3b32-3389-4a6b-9dea-2bb31b88eeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.416449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b3b32-3389-4a6b-9dea-2bb31b88eeec admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.416763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b3b32-3389-4a6b-9dea-2bb31b88eeec admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.417096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b3b32-3389-4a6b-9dea-2bb31b88eeec admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.417883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b3b32-3389-4a6b-9dea-2bb31b88eeec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.420196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b3b32-3389-4a6b-9dea-2bb31b88eeec admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.431319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1264/2525] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:05:38.435767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c9bc5-a549-428d-9a8f-aecb76feac49 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.446713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c9bc5-a549-428d-9a8f-aecb76feac49 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.452068 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e58303-07e6-4714-904c-a2ff2592af7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.453545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e58303-07e6-4714-904c-a2ff2592af7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.454009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e58303-07e6-4714-904c-a2ff2592af7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.454295 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e58303-07e6-4714-904c-a2ff2592af7f admin admin] PATH_INFO: `/v3/projects/095156d50cbd4066a6b45a3b813b587e/users/7f4f7b36c5574d87ae83b5563bd68c5d/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.470715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e58303-07e6-4714-904c-a2ff2592af7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=095156d50cbd4066a6b45a3b813b587e, user_id=7f4f7b36c5574d87ae83b5563bd68c5d, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.473929 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e58303-07e6-4714-904c-a2ff2592af7f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.489141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1262/2526] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:38 2022] PUT /identity/v3/projects/095156d50cbd4066a6b45a3b813b587e/users/7f4f7b36c5574d87ae83b5563bd68c5d/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:38.499542 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33845f4-a052-4bed-b10c-cd99d196f67a None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.499881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33845f4-a052-4bed-b10c-cd99d196f67a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.500163 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33845f4-a052-4bed-b10c-cd99d196f67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.529972 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-f33845f4-a052-4bed-b10c-cd99d196f67a None None] MFA Rules not processed for user `7f4f7b36c5574d87ae83b5563bd68c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:38.531436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f33845f4-a052-4bed-b10c-cd99d196f67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:38.596680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1265/2527] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:38.601194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e58303-07e6-4714-904c-a2ff2592af7f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.667751 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e58303-07e6-4714-904c-a2ff2592af7f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.672677 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c2243-479d-4da6-8071-428bd6bdcaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.673337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c2243-479d-4da6-8071-428bd6bdcaab admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.673675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c2243-479d-4da6-8071-428bd6bdcaab admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.673977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c2243-479d-4da6-8071-428bd6bdcaab admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.674684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c2243-479d-4da6-8071-428bd6bdcaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.676596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c2243-479d-4da6-8071-428bd6bdcaab admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.710201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1263/2528] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:38 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:38.714209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33845f4-a052-4bed-b10c-cd99d196f67a None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.725969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33845f4-a052-4bed-b10c-cd99d196f67a None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.787123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc65ff5-3481-464d-8864-b7068126c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.787794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc65ff5-3481-464d-8864-b7068126c86b admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.788075 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc65ff5-3481-464d-8864-b7068126c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.788351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc65ff5-3481-464d-8864-b7068126c86b admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.789056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc65ff5-3481-464d-8864-b7068126c86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.791035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc65ff5-3481-464d-8864-b7068126c86b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.813712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1266/2529] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:38 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:05:38.817786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c2243-479d-4da6-8071-428bd6bdcaab admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.828136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c2243-479d-4da6-8071-428bd6bdcaab admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.833398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511558b9-d232-4590-8214-7743ee181d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.834094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511558b9-d232-4590-8214-7743ee181d66 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.834552 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511558b9-d232-4590-8214-7743ee181d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.834979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511558b9-d232-4590-8214-7743ee181d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.835888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511558b9-d232-4590-8214-7743ee181d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.837698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511558b9-d232-4590-8214-7743ee181d66 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.850394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1264/2530] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:38.854687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc65ff5-3481-464d-8864-b7068126c86b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.867713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc65ff5-3481-464d-8864-b7068126c86b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.873949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8ce5f-d263-4ee1-8bff-73f2dea9332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.874618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8ce5f-d263-4ee1-8bff-73f2dea9332a admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.874901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8ce5f-d263-4ee1-8bff-73f2dea9332a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.875176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8ce5f-d263-4ee1-8bff-73f2dea9332a admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.876002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8ce5f-d263-4ee1-8bff-73f2dea9332a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.877547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8ce5f-d263-4ee1-8bff-73f2dea9332a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.888076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1267/2531] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:38.892542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511558b9-d232-4590-8214-7743ee181d66 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:38.903069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511558b9-d232-4590-8214-7743ee181d66 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:38.907971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad4e3e-8791-489b-99c4-09201bdd4147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:38.908854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad4e3e-8791-489b-99c4-09201bdd4147 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.909144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad4e3e-8791-489b-99c4-09201bdd4147 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.909411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad4e3e-8791-489b-99c4-09201bdd4147 admin admin] PATH_INFO: `/v3/projects/7b5d7ca4da234085b30e3462d2a83079/users/4e0205b94d6f4f66b85a7880221d4ff2/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:38.925643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad4e3e-8791-489b-99c4-09201bdd4147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d7ca4da234085b30e3462d2a83079, user_id=4e0205b94d6f4f66b85a7880221d4ff2, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:38.928346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad4e3e-8791-489b-99c4-09201bdd4147 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:38.944851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1265/2532] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:38 2022] PUT /identity/v3/projects/7b5d7ca4da234085b30e3462d2a83079/users/4e0205b94d6f4f66b85a7880221d4ff2/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:38.959732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c6b5-6ea6-4c69-8bfa-1befd61774a2 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:38.959983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c6b5-6ea6-4c69-8bfa-1befd61774a2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:38.960344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c6b5-6ea6-4c69-8bfa-1befd61774a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.000240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6f01c6b5-6ea6-4c69-8bfa-1befd61774a2 None None] MFA Rules not processed for user `4e0205b94d6f4f66b85a7880221d4ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:39.002392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6f01c6b5-6ea6-4c69-8bfa-1befd61774a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:39.075390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1268/2533] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:39.080043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad4e3e-8791-489b-99c4-09201bdd4147 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:39.144090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad4e3e-8791-489b-99c4-09201bdd4147 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:39.148957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c940b-3134-4e41-819c-1c07230fd319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:39.149610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c940b-3134-4e41-819c-1c07230fd319 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:39.149888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c940b-3134-4e41-819c-1c07230fd319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:39.150190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c940b-3134-4e41-819c-1c07230fd319 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.150872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c940b-3134-4e41-819c-1c07230fd319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:39.152778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c940b-3134-4e41-819c-1c07230fd319 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:39.185253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1266/2534] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:39 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:39.191683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c6b5-6ea6-4c69-8bfa-1befd61774a2 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:39.205556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c6b5-6ea6-4c69-8bfa-1befd61774a2 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:39.272396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834143d-468a-4cc3-b88c-9963c317f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:39.273057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834143d-468a-4cc3-b88c-9963c317f90a admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:39.273429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834143d-468a-4cc3-b88c-9963c317f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:39.274216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834143d-468a-4cc3-b88c-9963c317f90a admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.275191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834143d-468a-4cc3-b88c-9963c317f90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:39.277622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834143d-468a-4cc3-b88c-9963c317f90a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:39.302214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1269/2535] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:39 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:39.307464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c940b-3134-4e41-819c-1c07230fd319 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:39.323213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c940b-3134-4e41-819c-1c07230fd319 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:39.329268 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d6fec-1b9d-453f-9154-59288b6ac89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:39.330001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d6fec-1b9d-453f-9154-59288b6ac89b admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:39.330316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d6fec-1b9d-453f-9154-59288b6ac89b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:39.330656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d6fec-1b9d-453f-9154-59288b6ac89b admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.331561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d6fec-1b9d-453f-9154-59288b6ac89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:39.334011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d6fec-1b9d-453f-9154-59288b6ac89b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:39.348286 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1267/2536] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:39.353121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834143d-468a-4cc3-b88c-9963c317f90a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:39.364493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834143d-468a-4cc3-b88c-9963c317f90a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:39.370578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d913020-c478-4250-9d97-3fa0439b1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:39.371463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d913020-c478-4250-9d97-3fa0439b1783 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:39.371996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d913020-c478-4250-9d97-3fa0439b1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:39.372316 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d913020-c478-4250-9d97-3fa0439b1783 admin admin] PATH_INFO: `/v3/projects/65607567858d40208eedf28c4db87af2/users/6ababeeaecc74a88b861a069c2becdc9/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.389801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d913020-c478-4250-9d97-3fa0439b1783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65607567858d40208eedf28c4db87af2, user_id=6ababeeaecc74a88b861a069c2becdc9, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:39.392503 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d913020-c478-4250-9d97-3fa0439b1783 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:39.407786 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1270/2537] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:39 2022] PUT /identity/v3/projects/65607567858d40208eedf28c4db87af2/users/6ababeeaecc74a88b861a069c2becdc9/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:39.412793 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d6fec-1b9d-453f-9154-59288b6ac89b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:39.429656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d6fec-1b9d-453f-9154-59288b6ac89b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:39.498789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e3d26-ec13-4c83-9a6b-e9982e277fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:39.499466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e3d26-ec13-4c83-9a6b-e9982e277fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:39.499748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e3d26-ec13-4c83-9a6b-e9982e277fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:39.500024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e3d26-ec13-4c83-9a6b-e9982e277fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.500754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e3d26-ec13-4c83-9a6b-e9982e277fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:39.502403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e3d26-ec13-4c83-9a6b-e9982e277fb2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:39.513725 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1268/2538] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:05:39.517631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d913020-c478-4250-9d97-3fa0439b1783 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:39.529219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d913020-c478-4250-9d97-3fa0439b1783 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:39.533780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e703a6-8efa-4472-8c6a-fa5c6d7fbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:39.534726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e703a6-8efa-4472-8c6a-fa5c6d7fbcfe admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:39.535004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e703a6-8efa-4472-8c6a-fa5c6d7fbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:39.535286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e703a6-8efa-4472-8c6a-fa5c6d7fbcfe admin admin] PATH_INFO: `/v3/projects/65607567858d40208eedf28c4db87af2/users/6ababeeaecc74a88b861a069c2becdc9/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.537256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e703a6-8efa-4472-8c6a-fa5c6d7fbcfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=65607567858d40208eedf28c4db87af2, user_id=6ababeeaecc74a88b861a069c2becdc9, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:39.539932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e703a6-8efa-4472-8c6a-fa5c6d7fbcfe admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:39.551236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1271/2539] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:39 2022] PUT /identity/v3/projects/65607567858d40208eedf28c4db87af2/users/6ababeeaecc74a88b861a069c2becdc9/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:39.561705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea9330-fe0f-4e86-95a0-035cbd26a003 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:39.562020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea9330-fe0f-4e86-95a0-035cbd26a003 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:39.562300 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea9330-fe0f-4e86-95a0-035cbd26a003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.589865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-9eea9330-fe0f-4e86-95a0-035cbd26a003 None None] MFA Rules not processed for user `6ababeeaecc74a88b861a069c2becdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:39.592296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9eea9330-fe0f-4e86-95a0-035cbd26a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:39.659795 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1269/2540] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:39.671788 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e703a6-8efa-4472-8c6a-fa5c6d7fbcfe admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:39.674687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-32e703a6-8efa-4472-8c6a-fa5c6d7fbcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:39.749513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e703a6-8efa-4472-8c6a-fa5c6d7fbcfe admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:39.753735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99ec65-29ba-4511-ad86-0aaa1c7f1dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:39.754426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99ec65-29ba-4511-ad86-0aaa1c7f1dea service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:39.754802 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99ec65-29ba-4511-ad86-0aaa1c7f1dea service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:39.754974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99ec65-29ba-4511-ad86-0aaa1c7f1dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.764389 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99ec65-29ba-4511-ad86-0aaa1c7f1dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:39.765817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99ec65-29ba-4511-ad86-0aaa1c7f1dea service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:39.775135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1272/2541] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:39.817876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea9330-fe0f-4e86-95a0-035cbd26a003 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:39.819340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9eea9330-fe0f-4e86-95a0-035cbd26a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:39.832089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea9330-fe0f-4e86-95a0-035cbd26a003 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:39.838434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f995d-0019-4443-a3e0-4799b66a2c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:39.839083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f995d-0019-4443-a3e0-4799b66a2c49 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:39.839359 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f995d-0019-4443-a3e0-4799b66a2c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:39.839629 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f995d-0019-4443-a3e0-4799b66a2c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:39.899771 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f995d-0019-4443-a3e0-4799b66a2c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:39.901238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f995d-0019-4443-a3e0-4799b66a2c49 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:39.910447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1270/2542] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:41.932376 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c790a-bbbe-46c1-8620-ba68da2a2aa4 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:41.932902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c790a-bbbe-46c1-8620-ba68da2a2aa4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:41.932902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c790a-bbbe-46c1-8620-ba68da2a2aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:41.952175 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-d80c790a-bbbe-46c1-8620-ba68da2a2aa4 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:41.953420 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-d80c790a-bbbe-46c1-8620-ba68da2a2aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:42.022145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1273/2543] 10.222.0.49 () {58 vars in 967 bytes} [Tue Mar 22 20:05:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:42.038140 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f995d-0019-4443-a3e0-4799b66a2c49 service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:42.041172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-247f995d-0019-4443-a3e0-4799b66a2c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:42.130192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f995d-0019-4443-a3e0-4799b66a2c49 service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:42.135235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b7ec-aa8e-4263-afbc-c55d1e41cb78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:42.135907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b7ec-aa8e-4263-afbc-c55d1e41cb78 service swift] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:42.136171 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b7ec-aa8e-4263-afbc-c55d1e41cb78 service swift] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:42.136448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b7ec-aa8e-4263-afbc-c55d1e41cb78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:42.145343 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011b7ec-aa8e-4263-afbc-c55d1e41cb78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:42.147057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011b7ec-aa8e-4263-afbc-c55d1e41cb78 service swift] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:42.155151 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1271/2544] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:05:42.860498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c790a-bbbe-46c1-8620-ba68da2a2aa4 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:42.926611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c790a-bbbe-46c1-8620-ba68da2a2aa4 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:42.931858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:42.932783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:42.933491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:42.933491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] PATH_INFO: `/v3/users/7f4f7b36c5574d87ae83b5563bd68c5d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:42.934993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4f7b36c5574d87ae83b5563bd68c5d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:42.937150 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:42.988478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4f7b36c5574d87ae83b5563bd68c5d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:42.989160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4f7b36c5574d87ae83b5563bd68c5d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:42.989761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4f7b36c5574d87ae83b5563bd68c5d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:42.998652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4f7b36c5574d87ae83b5563bd68c5d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.005654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4f7b36c5574d87ae83b5563bd68c5d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.022957 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1274/2545] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:05:42 2022] DELETE /identity/v3/users/7f4f7b36c5574d87ae83b5563bd68c5d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:43.028801 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25602094-827f-4635-a26b-bfda91940a2f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:43.029108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25602094-827f-4635-a26b-bfda91940a2f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:43.029369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25602094-827f-4635-a26b-bfda91940a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:43.061820 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-25602094-827f-4635-a26b-bfda91940a2f None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:43.063777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-25602094-827f-4635-a26b-bfda91940a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:43.128723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1272/2546] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:05:43.140327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:43.141994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:43.230694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba24c8-b60f-4570-a266-54a33e62b8a3 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:43.234621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8450b8-85c8-4571-81c8-853bd7b88949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:43.235272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8450b8-85c8-4571-81c8-853bd7b88949 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:43.235555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8450b8-85c8-4571-81c8-853bd7b88949 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:43.235850 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8450b8-85c8-4571-81c8-853bd7b88949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:43.247515 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8450b8-85c8-4571-81c8-853bd7b88949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:43.249005 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8450b8-85c8-4571-81c8-853bd7b88949 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:43.259035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1275/2547] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:43.542601 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25602094-827f-4635-a26b-bfda91940a2f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:43.544263 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-25602094-827f-4635-a26b-bfda91940a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:43.556246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25602094-827f-4635-a26b-bfda91940a2f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:43.561983 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:43.562814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:43.563101 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:43.563548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] PATH_INFO: `/v3/projects/095156d50cbd4066a6b45a3b813b587e` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:43.564798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=095156d50cbd4066a6b45a3b813b587e)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:43.566730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:43.615094 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095156d50cbd4066a6b45a3b813b587e', 'request_id': 'req-61021140-c46a-47f3-adf9-829c828f89ab'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.621215 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095156d50cbd4066a6b45a3b813b587e', 'request_id': 'req-61021140-c46a-47f3-adf9-829c828f89ab'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.631252 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095156d50cbd4066a6b45a3b813b587e', 'request_id': 'req-61021140-c46a-47f3-adf9-829c828f89ab'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.643858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] The token cache is being invalidate because project 095156d50cbd4066a6b45a3b813b587e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:05:43.644146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.644904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.646477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1273/2548] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:05:43 2022] DELETE /identity/v3/projects/095156d50cbd4066a6b45a3b813b587e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:43.650381 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8450b8-85c8-4571-81c8-853bd7b88949 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:43.659783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8450b8-85c8-4571-81c8-853bd7b88949 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:43.724745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:43.725651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:43.725919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:43.726211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] PATH_INFO: `/v3/users/4e0205b94d6f4f66b85a7880221d4ff2` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:43.727441 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0205b94d6f4f66b85a7880221d4ff2)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:43.729373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:43.779210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0205b94d6f4f66b85a7880221d4ff2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.779954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0205b94d6f4f66b85a7880221d4ff2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.780651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0205b94d6f4f66b85a7880221d4ff2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.789508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0205b94d6f4f66b85a7880221d4ff2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.796998 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0205b94d6f4f66b85a7880221d4ff2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:43.813920 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1276/2549] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:05:43 2022] DELETE /identity/v3/users/4e0205b94d6f4f66b85a7880221d4ff2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:44.097390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:44.099001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:44.114532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021140-c46a-47f3-adf9-829c828f89ab admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:44.180857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:44.181738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:44.182049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:44.182294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] PATH_INFO: `/v3/projects/7b5d7ca4da234085b30e3462d2a83079` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:44.183632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5d7ca4da234085b30e3462d2a83079)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:44.185606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:44.244774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5d7ca4da234085b30e3462d2a83079', 'request_id': 'req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.251126 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5d7ca4da234085b30e3462d2a83079', 'request_id': 'req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.259877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5d7ca4da234085b30e3462d2a83079', 'request_id': 'req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.271791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] The token cache is being invalidate because project 7b5d7ca4da234085b30e3462d2a83079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:05:44.272078 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.272730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.274301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1274/2550] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:05:44 2022] DELETE /identity/v3/projects/7b5d7ca4da234085b30e3462d2a83079 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:44.279071 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:44.280991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:44.295211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b30880-b5a8-449c-8a56-d4567384160c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:44.357838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:44.359064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:44.359541 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:44.359973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] PATH_INFO: `/v3/users/6ababeeaecc74a88b861a069c2becdc9` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:44.361973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ababeeaecc74a88b861a069c2becdc9)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:44.365113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:44.441019 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ababeeaecc74a88b861a069c2becdc9'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.441871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ababeeaecc74a88b861a069c2becdc9'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.442743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ababeeaecc74a88b861a069c2becdc9'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.453377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ababeeaecc74a88b861a069c2becdc9'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.464496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-0b4cb1ff-9b5b-445c-be46-a4585ed08f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ababeeaecc74a88b861a069c2becdc9'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:44.485739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1277/2551] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:05:44 2022] DELETE /identity/v3/users/6ababeeaecc74a88b861a069c2becdc9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:44.899465 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:44.901046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:44.915830 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f0b9f-e4c6-4780-bd47-7a986dd87732 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:44.990273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:44.991499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:44.991781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:44.992824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] PATH_INFO: `/v3/projects/65607567858d40208eedf28c4db87af2` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:44.994602 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65607567858d40208eedf28c4db87af2)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:44.996970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.049660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65607567858d40208eedf28c4db87af2', 'request_id': 'req-133ca8a2-0bdc-4bad-8ad4-98b180223938'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:45.055119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65607567858d40208eedf28c4db87af2', 'request_id': 'req-133ca8a2-0bdc-4bad-8ad4-98b180223938'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:45.063955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65607567858d40208eedf28c4db87af2', 'request_id': 'req-133ca8a2-0bdc-4bad-8ad4-98b180223938'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:45.075616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] The token cache is being invalidate because project 65607567858d40208eedf28c4db87af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:05:45.075904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:45.076582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-133ca8a2-0bdc-4bad-8ad4-98b180223938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:45.078285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1275/2552] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:05:44 2022] DELETE /identity/v3/projects/65607567858d40208eedf28c4db87af2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:45.084155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96590ee-ab11-4723-a33a-02c02f5df751 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.084431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96590ee-ab11-4723-a33a-02c02f5df751 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.084715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96590ee-ab11-4723-a33a-02c02f5df751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.104233 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c96590ee-ab11-4723-a33a-02c02f5df751 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:45.105590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c96590ee-ab11-4723-a33a-02c02f5df751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:45.165867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1278/2553] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:45.175716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992fe3-1f43-4c78-9484-4267af57b059 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.176342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992fe3-1f43-4c78-9484-4267af57b059 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.176342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992fe3-1f43-4c78-9484-4267af57b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.202915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-0e992fe3-1f43-4c78-9484-4267af57b059 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:45.204132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0e992fe3-1f43-4c78-9484-4267af57b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:45.212965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1276/2554] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:45.218254 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96590ee-ab11-4723-a33a-02c02f5df751 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.232768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96590ee-ab11-4723-a33a-02c02f5df751 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.238155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7395c22-5373-4b7a-baf0-92ed5e267855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.238979 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7395c22-5373-4b7a-baf0-92ed5e267855 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.239469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7395c22-5373-4b7a-baf0-92ed5e267855 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.239469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7395c22-5373-4b7a-baf0-92ed5e267855 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.240258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7395c22-5373-4b7a-baf0-92ed5e267855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:05:45.240572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7395c22-5373-4b7a-baf0-92ed5e267855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.242336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7395c22-5373-4b7a-baf0-92ed5e267855 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.255187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1279/2555] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:05:45.259758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992fe3-1f43-4c78-9484-4267af57b059 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.269517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992fe3-1f43-4c78-9484-4267af57b059 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.275428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11254961-dd61-4057-b886-7ade046a03da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.276089 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11254961-dd61-4057-b886-7ade046a03da admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.276370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11254961-dd61-4057-b886-7ade046a03da admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.276646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11254961-dd61-4057-b886-7ade046a03da admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.277356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11254961-dd61-4057-b886-7ade046a03da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.279508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11254961-dd61-4057-b886-7ade046a03da admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.307413 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1277/2556] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:45 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:45.311974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7395c22-5373-4b7a-baf0-92ed5e267855 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.322098 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7395c22-5373-4b7a-baf0-92ed5e267855 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.382784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b279-cc7c-4833-8a0a-d38ae209fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.383486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b279-cc7c-4833-8a0a-d38ae209fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.383769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b279-cc7c-4833-8a0a-d38ae209fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.384040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b279-cc7c-4833-8a0a-d38ae209fe6f admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.384730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293b279-cc7c-4833-8a0a-d38ae209fe6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.386769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293b279-cc7c-4833-8a0a-d38ae209fe6f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.410794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1280/2557] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:45 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:45.415171 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11254961-dd61-4057-b886-7ade046a03da admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.425767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11254961-dd61-4057-b886-7ade046a03da admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.431763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05da98-89f6-412f-8d0a-cf41439fb177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.432434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05da98-89f6-412f-8d0a-cf41439fb177 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.432709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05da98-89f6-412f-8d0a-cf41439fb177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.432982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05da98-89f6-412f-8d0a-cf41439fb177 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.433710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05da98-89f6-412f-8d0a-cf41439fb177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.435518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05da98-89f6-412f-8d0a-cf41439fb177 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.446159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1278/2558] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:45.450589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b279-cc7c-4833-8a0a-d38ae209fe6f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.460795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b279-cc7c-4833-8a0a-d38ae209fe6f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.466256 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac1fe7-2efb-4a1d-b98d-55e813810c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.466947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac1fe7-2efb-4a1d-b98d-55e813810c19 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.467231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac1fe7-2efb-4a1d-b98d-55e813810c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.467508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac1fe7-2efb-4a1d-b98d-55e813810c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.468231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac1fe7-2efb-4a1d-b98d-55e813810c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.469876 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac1fe7-2efb-4a1d-b98d-55e813810c19 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.479776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1281/2559] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:45.484318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05da98-89f6-412f-8d0a-cf41439fb177 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.494472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05da98-89f6-412f-8d0a-cf41439fb177 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.500229 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd284e1-4f04-4034-a55a-fdb7faa18d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.501187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd284e1-4f04-4034-a55a-fdb7faa18d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.501467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd284e1-4f04-4034-a55a-fdb7faa18d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.501747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd284e1-4f04-4034-a55a-fdb7faa18d00 admin admin] PATH_INFO: `/v3/projects/931cca36002c435e9696b63df9583c1d/users/47f2eccb4f4e476f9e931cddd2d86ca6/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.517278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd284e1-4f04-4034-a55a-fdb7faa18d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=931cca36002c435e9696b63df9583c1d, user_id=47f2eccb4f4e476f9e931cddd2d86ca6, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.520034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd284e1-4f04-4034-a55a-fdb7faa18d00 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.533188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1279/2560] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:45 2022] PUT /identity/v3/projects/931cca36002c435e9696b63df9583c1d/users/47f2eccb4f4e476f9e931cddd2d86ca6/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:45.545716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d84029-1eb3-4275-9575-b47a1a0d3ce4 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.546010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d84029-1eb3-4275-9575-b47a1a0d3ce4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.546336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d84029-1eb3-4275-9575-b47a1a0d3ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.574904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-22d84029-1eb3-4275-9575-b47a1a0d3ce4 None None] MFA Rules not processed for user `47f2eccb4f4e476f9e931cddd2d86ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:45.576291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-22d84029-1eb3-4275-9575-b47a1a0d3ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:45.642280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1282/2561] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:45.649276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd284e1-4f04-4034-a55a-fdb7faa18d00 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.720074 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd284e1-4f04-4034-a55a-fdb7faa18d00 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.725626 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3966-7430-4cda-a6fd-d63e46f77437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.726310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3966-7430-4cda-a6fd-d63e46f77437 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.726592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3966-7430-4cda-a6fd-d63e46f77437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.726843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3966-7430-4cda-a6fd-d63e46f77437 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.727541 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3966-7430-4cda-a6fd-d63e46f77437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.729440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3966-7430-4cda-a6fd-d63e46f77437 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.756840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1280/2562] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:45 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:45.760861 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d84029-1eb3-4275-9575-b47a1a0d3ce4 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.771857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d84029-1eb3-4275-9575-b47a1a0d3ce4 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.830697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba815cf-934b-4c9a-8aa4-cbbf3730e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.831364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba815cf-934b-4c9a-8aa4-cbbf3730e917 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.831643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba815cf-934b-4c9a-8aa4-cbbf3730e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.831938 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba815cf-934b-4c9a-8aa4-cbbf3730e917 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.832655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba815cf-934b-4c9a-8aa4-cbbf3730e917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.834622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba815cf-934b-4c9a-8aa4-cbbf3730e917 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.860398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1283/2563] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:45 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:45.864645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3966-7430-4cda-a6fd-d63e46f77437 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.875812 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3966-7430-4cda-a6fd-d63e46f77437 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.880989 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c1f0-b62c-4ba1-9471-0def56f025de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.881628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c1f0-b62c-4ba1-9471-0def56f025de admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.881904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c1f0-b62c-4ba1-9471-0def56f025de admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.882213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c1f0-b62c-4ba1-9471-0def56f025de admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.882931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c1f0-b62c-4ba1-9471-0def56f025de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.884530 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c1f0-b62c-4ba1-9471-0def56f025de admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.895692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1281/2564] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:45.899988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba815cf-934b-4c9a-8aa4-cbbf3730e917 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.910621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba815cf-934b-4c9a-8aa4-cbbf3730e917 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:45.915492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3cb45-84d2-4ed3-b513-6a06a963df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:45.916384 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3cb45-84d2-4ed3-b513-6a06a963df5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:45.916664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3cb45-84d2-4ed3-b513-6a06a963df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:45.916938 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3cb45-84d2-4ed3-b513-6a06a963df5a admin admin] PATH_INFO: `/v3/projects/5b4abb13586f4db0830c1e2ca0027542/users/39725891fdd64eef85bdb1c2da6f719f/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:45.931791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3cb45-84d2-4ed3-b513-6a06a963df5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4abb13586f4db0830c1e2ca0027542, user_id=39725891fdd64eef85bdb1c2da6f719f, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:45.934842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3cb45-84d2-4ed3-b513-6a06a963df5a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:45.951313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1284/2565] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:45 2022] PUT /identity/v3/projects/5b4abb13586f4db0830c1e2ca0027542/users/39725891fdd64eef85bdb1c2da6f719f/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:45.955377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c1f0-b62c-4ba1-9471-0def56f025de admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:45.966607 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c1f0-b62c-4ba1-9471-0def56f025de admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:46.031116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed54be-165b-42d9-b8ad-9dd8f497c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:46.031721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed54be-165b-42d9-b8ad-9dd8f497c39f admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:46.032004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed54be-165b-42d9-b8ad-9dd8f497c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:46.032279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed54be-165b-42d9-b8ad-9dd8f497c39f admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:46.033047 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed54be-165b-42d9-b8ad-9dd8f497c39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:46.034736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed54be-165b-42d9-b8ad-9dd8f497c39f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:46.045875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1282/2566] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:46.052193 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3cb45-84d2-4ed3-b513-6a06a963df5a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:46.065870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3cb45-84d2-4ed3-b513-6a06a963df5a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:46.070859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf73ee-0524-42bd-84c5-29d9f261abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:46.071752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf73ee-0524-42bd-84c5-29d9f261abe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:46.072035 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf73ee-0524-42bd-84c5-29d9f261abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:46.072312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf73ee-0524-42bd-84c5-29d9f261abe3 admin admin] PATH_INFO: `/v3/projects/5b4abb13586f4db0830c1e2ca0027542/users/39725891fdd64eef85bdb1c2da6f719f/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:46.074379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf73ee-0524-42bd-84c5-29d9f261abe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4abb13586f4db0830c1e2ca0027542, user_id=39725891fdd64eef85bdb1c2da6f719f, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:46.077103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf73ee-0524-42bd-84c5-29d9f261abe3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:46.088003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1285/2567] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:46 2022] PUT /identity/v3/projects/5b4abb13586f4db0830c1e2ca0027542/users/39725891fdd64eef85bdb1c2da6f719f/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:46.100327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a620af-3b09-4038-b7f6-dcabdfaab3d9 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:46.100821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a620af-3b09-4038-b7f6-dcabdfaab3d9 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:46.101203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a620af-3b09-4038-b7f6-dcabdfaab3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:46.135257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-03a620af-3b09-4038-b7f6-dcabdfaab3d9 None None] MFA Rules not processed for user `39725891fdd64eef85bdb1c2da6f719f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:46.136485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-03a620af-3b09-4038-b7f6-dcabdfaab3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:46.207159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1283/2568] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:46.219695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf73ee-0524-42bd-84c5-29d9f261abe3 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:46.221736 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-78bf73ee-0524-42bd-84c5-29d9f261abe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:46.280885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf73ee-0524-42bd-84c5-29d9f261abe3 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:46.285038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd6e00-cd74-45d5-acfd-31ebbd5ca7c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:46.285632 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6e00-cd74-45d5-acfd-31ebbd5ca7c3 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:46.285930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6e00-cd74-45d5-acfd-31ebbd5ca7c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:46.286240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6e00-cd74-45d5-acfd-31ebbd5ca7c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:46.295947 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd6e00-cd74-45d5-acfd-31ebbd5ca7c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:46.297371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd6e00-cd74-45d5-acfd-31ebbd5ca7c3 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:46.307065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1286/2569] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:05:46.694104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a620af-3b09-4038-b7f6-dcabdfaab3d9 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:46.758395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a620af-3b09-4038-b7f6-dcabdfaab3d9 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:46.764412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:46.765403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:46.765877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:46.766384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] PATH_INFO: `/v3/users/47f2eccb4f4e476f9e931cddd2d86ca6` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:46.768301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f2eccb4f4e476f9e931cddd2d86ca6)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:46.772389 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:46.828327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f2eccb4f4e476f9e931cddd2d86ca6'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:46.843205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f2eccb4f4e476f9e931cddd2d86ca6'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:46.852948 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f2eccb4f4e476f9e931cddd2d86ca6'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:46.853611 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f2eccb4f4e476f9e931cddd2d86ca6'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:46.861368 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f2eccb4f4e476f9e931cddd2d86ca6'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:46.867386 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1284/2570] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:05:46 2022] DELETE /identity/v3/users/47f2eccb4f4e476f9e931cddd2d86ca6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:46.872826 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ab7b1-2697-4942-bbfa-3aef678119a8 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:46.873331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ab7b1-2697-4942-bbfa-3aef678119a8 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:46.873495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ab7b1-2697-4942-bbfa-3aef678119a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:46.900158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-ee6ab7b1-2697-4942-bbfa-3aef678119a8 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:46.901407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ee6ab7b1-2697-4942-bbfa-3aef678119a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:46.964325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1287/2571] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:46.977114 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:46.978897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:47.037606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082d1d8-c00a-45c8-9bdf-7ec91e9b81f1 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:47.041353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a34e45-ef5f-4560-99bd-d70bce4509f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:47.042025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a34e45-ef5f-4560-99bd-d70bce4509f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:47.042312 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a34e45-ef5f-4560-99bd-d70bce4509f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:47.042590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a34e45-ef5f-4560-99bd-d70bce4509f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:47.052010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a34e45-ef5f-4560-99bd-d70bce4509f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:47.053456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a34e45-ef5f-4560-99bd-d70bce4509f0 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:47.062980 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1285/2572] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:47.482664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ab7b1-2697-4942-bbfa-3aef678119a8 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:47.484160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ee6ab7b1-2697-4942-bbfa-3aef678119a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:47.496424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ab7b1-2697-4942-bbfa-3aef678119a8 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:47.502318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:47.503312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:47.503658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:47.503996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] PATH_INFO: `/v3/projects/931cca36002c435e9696b63df9583c1d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:47.505351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] RBAC: Authorizing `identity:delete_project(project_id=931cca36002c435e9696b63df9583c1d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:47.507407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:47.571023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931cca36002c435e9696b63df9583c1d', 'request_id': 'req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.576792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931cca36002c435e9696b63df9583c1d', 'request_id': 'req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.583239 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931cca36002c435e9696b63df9583c1d', 'request_id': 'req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.597044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] The token cache is being invalidate because project 931cca36002c435e9696b63df9583c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:05:47.597373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.597986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.599790 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1288/2573] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:05:47 2022] DELETE /identity/v3/projects/931cca36002c435e9696b63df9583c1d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:47.603884 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a34e45-ef5f-4560-99bd-d70bce4509f0 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:47.613785 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a34e45-ef5f-4560-99bd-d70bce4509f0 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:47.670775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:47.672276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:47.672276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:47.672276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] PATH_INFO: `/v3/users/39725891fdd64eef85bdb1c2da6f719f` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:47.673442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39725891fdd64eef85bdb1c2da6f719f)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:47.675564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:47.725513 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39725891fdd64eef85bdb1c2da6f719f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.741408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39725891fdd64eef85bdb1c2da6f719f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.750256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39725891fdd64eef85bdb1c2da6f719f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.750956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39725891fdd64eef85bdb1c2da6f719f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.759172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-08b2f8d6-94f1-424d-88c2-4822c49c17a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39725891fdd64eef85bdb1c2da6f719f'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:47.766640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1286/2574] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:05:47 2022] DELETE /identity/v3/users/39725891fdd64eef85bdb1c2da6f719f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:05:48.053001 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:48.059586 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:48.088334 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c5d03-8425-4df3-a4e3-255ffe4a528c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:48.163495 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:48.164560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.164841 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.165126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] PATH_INFO: `/v3/projects/5b4abb13586f4db0830c1e2ca0027542` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.166770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4abb13586f4db0830c1e2ca0027542)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:48.169742 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:48.228023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4abb13586f4db0830c1e2ca0027542', 'request_id': 'req-55fbac90-d36a-42b4-9f55-5bf98b6db1da'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:48.235631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4abb13586f4db0830c1e2ca0027542', 'request_id': 'req-55fbac90-d36a-42b4-9f55-5bf98b6db1da'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:48.242606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4abb13586f4db0830c1e2ca0027542', 'request_id': 'req-55fbac90-d36a-42b4-9f55-5bf98b6db1da'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:48.258498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] The token cache is being invalidate because project 5b4abb13586f4db0830c1e2ca0027542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:05:48.258828 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:48.259452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-55fbac90-d36a-42b4-9f55-5bf98b6db1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:48.261309 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1289/2575] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:05:48 2022] DELETE /identity/v3/projects/5b4abb13586f4db0830c1e2ca0027542 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:48.266228 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433d3a9-90cc-46ea-982c-42c30e0f3424 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.266511 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433d3a9-90cc-46ea-982c-42c30e0f3424 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.266786 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433d3a9-90cc-46ea-982c-42c30e0f3424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.292416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c433d3a9-90cc-46ea-982c-42c30e0f3424 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:48.293681 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c433d3a9-90cc-46ea-982c-42c30e0f3424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:48.361256 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1287/2576] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:48.370478 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c7ba-bb85-4e67-855a-181a9d01ce9e None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.370696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c7ba-bb85-4e67-855a-181a9d01ce9e None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.370969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c7ba-bb85-4e67-855a-181a9d01ce9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.391250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-2917c7ba-bb85-4e67-855a-181a9d01ce9e None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:48.392568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2917c7ba-bb85-4e67-855a-181a9d01ce9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:48.401048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1290/2577] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:48.405618 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433d3a9-90cc-46ea-982c-42c30e0f3424 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:48.415489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433d3a9-90cc-46ea-982c-42c30e0f3424 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:48.421116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95600d33-944f-4fdb-aee5-e752d627e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:48.421855 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95600d33-944f-4fdb-aee5-e752d627e706 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.422172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95600d33-944f-4fdb-aee5-e752d627e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.422453 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95600d33-944f-4fdb-aee5-e752d627e706 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.423183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95600d33-944f-4fdb-aee5-e752d627e706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:05:48.423494 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95600d33-944f-4fdb-aee5-e752d627e706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:48.425109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95600d33-944f-4fdb-aee5-e752d627e706 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:48.437564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1288/2578] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:05:48.442433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c7ba-bb85-4e67-855a-181a9d01ce9e None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:48.451482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c7ba-bb85-4e67-855a-181a9d01ce9e None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:48.456354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6eccd-d056-43f5-9bf3-23e648523087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:48.457004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6eccd-d056-43f5-9bf3-23e648523087 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.457266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6eccd-d056-43f5-9bf3-23e648523087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.457539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6eccd-d056-43f5-9bf3-23e648523087 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.458265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6eccd-d056-43f5-9bf3-23e648523087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:48.460169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6eccd-d056-43f5-9bf3-23e648523087 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:48.487774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1291/2579] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:48 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:05:48.492084 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95600d33-944f-4fdb-aee5-e752d627e706 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:48.502328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95600d33-944f-4fdb-aee5-e752d627e706 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:48.562860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d52a8-ec20-4017-bf6f-4fef144aa132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:48.564766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d52a8-ec20-4017-bf6f-4fef144aa132 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.564766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d52a8-ec20-4017-bf6f-4fef144aa132 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.564766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d52a8-ec20-4017-bf6f-4fef144aa132 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.564766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d52a8-ec20-4017-bf6f-4fef144aa132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:48.566876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d52a8-ec20-4017-bf6f-4fef144aa132 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:48.594007 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1289/2580] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:48 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:48.596809 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6eccd-d056-43f5-9bf3-23e648523087 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:48.610214 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6eccd-d056-43f5-9bf3-23e648523087 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:48.616038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0123acc-356b-41bb-bcd0-f3207001278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:48.617230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0123acc-356b-41bb-bcd0-f3207001278c admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.617741 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0123acc-356b-41bb-bcd0-f3207001278c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.618244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0123acc-356b-41bb-bcd0-f3207001278c admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.619195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0123acc-356b-41bb-bcd0-f3207001278c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:48.621057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0123acc-356b-41bb-bcd0-f3207001278c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:48.637639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d52a8-ec20-4017-bf6f-4fef144aa132 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:48.638744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1292/2581] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:48.649226 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d52a8-ec20-4017-bf6f-4fef144aa132 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:48.654921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025f18f-acf9-476b-8090-7a6b23da3683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:48.655656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f18f-acf9-476b-8090-7a6b23da3683 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.655939 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f18f-acf9-476b-8090-7a6b23da3683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.656218 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f18f-acf9-476b-8090-7a6b23da3683 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.656955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025f18f-acf9-476b-8090-7a6b23da3683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:48.658790 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025f18f-acf9-476b-8090-7a6b23da3683 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:48.670253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1290/2582] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:48.674635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0123acc-356b-41bb-bcd0-f3207001278c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:48.685313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0123acc-356b-41bb-bcd0-f3207001278c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:48.690756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21413b95-c2c0-4b84-bba7-702465bf8cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:48.691699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413b95-c2c0-4b84-bba7-702465bf8cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.691978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413b95-c2c0-4b84-bba7-702465bf8cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.692255 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413b95-c2c0-4b84-bba7-702465bf8cfd admin admin] PATH_INFO: `/v3/projects/31c79632b12442e5aa14e4a4c9c02441/users/b3b2a3e4592343a9a293dc2500348025/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.709572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21413b95-c2c0-4b84-bba7-702465bf8cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c79632b12442e5aa14e4a4c9c02441, user_id=b3b2a3e4592343a9a293dc2500348025, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:48.712692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21413b95-c2c0-4b84-bba7-702465bf8cfd admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:48.729049 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1293/2583] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:48 2022] PUT /identity/v3/projects/31c79632b12442e5aa14e4a4c9c02441/users/b3b2a3e4592343a9a293dc2500348025/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:05:48.734355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa204225-4643-4b9c-9c50-67fdd0b5d013 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.734646 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa204225-4643-4b9c-9c50-67fdd0b5d013 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.734919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa204225-4643-4b9c-9c50-67fdd0b5d013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.753517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-aa204225-4643-4b9c-9c50-67fdd0b5d013 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:48.754767 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-aa204225-4643-4b9c-9c50-67fdd0b5d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:48.815079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1291/2584] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:48.824780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21413b95-c2c0-4b84-bba7-702465bf8cfd admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:48.827073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-21413b95-c2c0-4b84-bba7-702465bf8cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:48.891410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21413b95-c2c0-4b84-bba7-702465bf8cfd admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:48.895445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf0bd7-5e65-436b-8a8a-7146c9012b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:48.896114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0bd7-5e65-436b-8a8a-7146c9012b63 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:48.896391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0bd7-5e65-436b-8a8a-7146c9012b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:48.896824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0bd7-5e65-436b-8a8a-7146c9012b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:48.907280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf0bd7-5e65-436b-8a8a-7146c9012b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:48.908764 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf0bd7-5e65-436b-8a8a-7146c9012b63 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:48.919158 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1294/2585] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:49.579501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546e04c-8d9b-4e70-9843-75d0d3b516df None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:49.579789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546e04c-8d9b-4e70-9843-75d0d3b516df None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:49.580070 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546e04c-8d9b-4e70-9843-75d0d3b516df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:49.608818 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-5546e04c-8d9b-4e70-9843-75d0d3b516df None None] MFA Rules not processed for user `b3b2a3e4592343a9a293dc2500348025`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:49.610079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5546e04c-8d9b-4e70-9843-75d0d3b516df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:49.678965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1292/2586] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:49.683377 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf0bd7-5e65-436b-8a8a-7146c9012b63 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:49.694887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf0bd7-5e65-436b-8a8a-7146c9012b63 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:49.700431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e08b3-0a1e-4985-820f-42c4c13975ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:49.701263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e08b3-0a1e-4985-820f-42c4c13975ee admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:49.701644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e08b3-0a1e-4985-820f-42c4c13975ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:49.702079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e08b3-0a1e-4985-820f-42c4c13975ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:49.702890 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e08b3-0a1e-4985-820f-42c4c13975ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:49.705109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e08b3-0a1e-4985-820f-42c4c13975ee admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:49.749993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1295/2587] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:49 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:49.752159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546e04c-8d9b-4e70-9843-75d0d3b516df None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:49.766995 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546e04c-8d9b-4e70-9843-75d0d3b516df None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:49.835882 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42ca7-b5a7-4506-8d78-8128efd7ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:49.837344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42ca7-b5a7-4506-8d78-8128efd7ccca admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:49.837728 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42ca7-b5a7-4506-8d78-8128efd7ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:49.838124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42ca7-b5a7-4506-8d78-8128efd7ccca admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:49.839495 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b42ca7-b5a7-4506-8d78-8128efd7ccca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:49.843338 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b42ca7-b5a7-4506-8d78-8128efd7ccca admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:49.867022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1293/2588] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:49 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:49.871097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e08b3-0a1e-4985-820f-42c4c13975ee admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:49.884665 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e08b3-0a1e-4985-820f-42c4c13975ee admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:49.891767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36ccba-e977-4796-b5e5-53b7e5fc0b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:49.892571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36ccba-e977-4796-b5e5-53b7e5fc0b6e admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:49.892836 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36ccba-e977-4796-b5e5-53b7e5fc0b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:49.893177 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36ccba-e977-4796-b5e5-53b7e5fc0b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:49.894162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36ccba-e977-4796-b5e5-53b7e5fc0b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:49.896240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36ccba-e977-4796-b5e5-53b7e5fc0b6e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:49.908364 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1296/2589] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:05:49.913213 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42ca7-b5a7-4506-8d78-8128efd7ccca admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:49.925118 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42ca7-b5a7-4506-8d78-8128efd7ccca admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:49.932687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e329bb2-6bd6-4d3c-a340-79ca9b28505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:49.933895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e329bb2-6bd6-4d3c-a340-79ca9b28505d admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:49.934421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e329bb2-6bd6-4d3c-a340-79ca9b28505d admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:49.934714 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e329bb2-6bd6-4d3c-a340-79ca9b28505d admin admin] PATH_INFO: `/v3/projects/53b17c8a25c34d4683b3763ee9a9d60d/users/6e190cc6a574465f83a493a0649a735d/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:49.951108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e329bb2-6bd6-4d3c-a340-79ca9b28505d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b17c8a25c34d4683b3763ee9a9d60d, user_id=6e190cc6a574465f83a493a0649a735d, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:49.953774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e329bb2-6bd6-4d3c-a340-79ca9b28505d admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:49.969985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1294/2590] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:49 2022] PUT /identity/v3/projects/53b17c8a25c34d4683b3763ee9a9d60d/users/6e190cc6a574465f83a493a0649a735d/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:05:49.972122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36ccba-e977-4796-b5e5-53b7e5fc0b6e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:49.982644 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36ccba-e977-4796-b5e5-53b7e5fc0b6e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:50.047459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bd676-9b00-4389-bf3c-dc1a1a14fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:50.048289 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd676-9b00-4389-bf3c-dc1a1a14fa95 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:50.048688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd676-9b00-4389-bf3c-dc1a1a14fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:50.048967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd676-9b00-4389-bf3c-dc1a1a14fa95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:50.049724 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bd676-9b00-4389-bf3c-dc1a1a14fa95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:50.051503 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bd676-9b00-4389-bf3c-dc1a1a14fa95 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:50.066215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1297/2591] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:50.067850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e329bb2-6bd6-4d3c-a340-79ca9b28505d admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:50.080455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e329bb2-6bd6-4d3c-a340-79ca9b28505d admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:50.085393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b64c05-fb6a-46a2-b1ab-8eddc4d97a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:50.086330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b64c05-fb6a-46a2-b1ab-8eddc4d97a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:50.086614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b64c05-fb6a-46a2-b1ab-8eddc4d97a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:50.087020 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b64c05-fb6a-46a2-b1ab-8eddc4d97a2a admin admin] PATH_INFO: `/v3/projects/53b17c8a25c34d4683b3763ee9a9d60d/users/6e190cc6a574465f83a493a0649a735d/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:50.088994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b64c05-fb6a-46a2-b1ab-8eddc4d97a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b17c8a25c34d4683b3763ee9a9d60d, user_id=6e190cc6a574465f83a493a0649a735d, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:50.092240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b64c05-fb6a-46a2-b1ab-8eddc4d97a2a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:50.103285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1295/2592] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:50 2022] PUT /identity/v3/projects/53b17c8a25c34d4683b3763ee9a9d60d/users/6e190cc6a574465f83a493a0649a735d/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:05:50.769410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3c0d6-8fb7-4bd0-ad7f-a3127f454a53 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:50.770378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3c0d6-8fb7-4bd0-ad7f-a3127f454a53 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:50.770713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3c0d6-8fb7-4bd0-ad7f-a3127f454a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:50.804047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-7eb3c0d6-8fb7-4bd0-ad7f-a3127f454a53 None None] MFA Rules not processed for user `6e190cc6a574465f83a493a0649a735d`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:50.805260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7eb3c0d6-8fb7-4bd0-ad7f-a3127f454a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:50.890247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1298/2593] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:50.903850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b64c05-fb6a-46a2-b1ab-8eddc4d97a2a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:50.905712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d7b64c05-fb6a-46a2-b1ab-8eddc4d97a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:50.976299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b64c05-fb6a-46a2-b1ab-8eddc4d97a2a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:50.982446 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe503-90e8-463c-ad35-52d53b6f1a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:50.983106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe503-90e8-463c-ad35-52d53b6f1a00 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:50.983390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe503-90e8-463c-ad35-52d53b6f1a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:50.983666 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe503-90e8-463c-ad35-52d53b6f1a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:51.049186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe503-90e8-463c-ad35-52d53b6f1a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:51.051308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe503-90e8-463c-ad35-52d53b6f1a00 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:51.064863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1296/2594] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:52.433211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3c0d6-8fb7-4bd0-ad7f-a3127f454a53 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:52.445045 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3c0d6-8fb7-4bd0-ad7f-a3127f454a53 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:52.450145 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcd766-256c-42af-ab14-1eae47e9a0fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:52.450792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcd766-256c-42af-ab14-1eae47e9a0fe service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:52.451076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcd766-256c-42af-ab14-1eae47e9a0fe service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:52.451341 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcd766-256c-42af-ab14-1eae47e9a0fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:52.461894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcd766-256c-42af-ab14-1eae47e9a0fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:52.463318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcd766-256c-42af-ab14-1eae47e9a0fe service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:52.474647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1299/2595] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:54.136712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe503-90e8-463c-ad35-52d53b6f1a00 service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:54.194450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe503-90e8-463c-ad35-52d53b6f1a00 service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:54.199010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917856e7-51f1-49c0-bbc5-627b49834d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:54.199913 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917856e7-51f1-49c0-bbc5-627b49834d56 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:54.200202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917856e7-51f1-49c0-bbc5-627b49834d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:54.200477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917856e7-51f1-49c0-bbc5-627b49834d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:54.202482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-917856e7-51f1-49c0-bbc5-627b49834d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:54.267083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917856e7-51f1-49c0-bbc5-627b49834d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:54.268455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917856e7-51f1-49c0-bbc5-627b49834d56 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:54.278333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1297/2596] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:05:57.714195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcd766-256c-42af-ab14-1eae47e9a0fe service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:57.717323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9cdcd766-256c-42af-ab14-1eae47e9a0fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:57.732862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcd766-256c-42af-ab14-1eae47e9a0fe service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:57.738138 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:57.739041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:57.739329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:57.739600 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] PATH_INFO: `/v3/users/9680269cd8504c36b6027040e185a817` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:57.740846 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9680269cd8504c36b6027040e185a817)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:57.743023 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:57.796774 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9680269cd8504c36b6027040e185a817'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:57.797427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9680269cd8504c36b6027040e185a817'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:57.798050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9680269cd8504c36b6027040e185a817'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:57.807246 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9680269cd8504c36b6027040e185a817'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:57.815427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-16fd3b1c-b334-4af1-8673-8f15ac0e9888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9680269cd8504c36b6027040e185a817'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:57.835400 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1300/2597] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:05:57 2022] DELETE /identity/v3/users/9680269cd8504c36b6027040e185a817 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:58.024748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917856e7-51f1-49c0-bbc5-627b49834d56 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:58.037546 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917856e7-51f1-49c0-bbc5-627b49834d56 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:58.099436 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:58.100318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.100592 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.100857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] PATH_INFO: `/v3/projects/5b2b44d95eff408ab0bd9a23123f5158` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.102245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2b44d95eff408ab0bd9a23123f5158)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:58.104218 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:58.159016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2b44d95eff408ab0bd9a23123f5158', 'request_id': 'req-7a4d885a-168a-475c-b4cd-582dafb2d6f4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:58.164582 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2b44d95eff408ab0bd9a23123f5158', 'request_id': 'req-7a4d885a-168a-475c-b4cd-582dafb2d6f4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:58.174298 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2b44d95eff408ab0bd9a23123f5158', 'request_id': 'req-7a4d885a-168a-475c-b4cd-582dafb2d6f4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:58.186470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] The token cache is being invalidate because project 5b2b44d95eff408ab0bd9a23123f5158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:05:58.186763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:58.187531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-7a4d885a-168a-475c-b4cd-582dafb2d6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:05:58.189211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1298/2598] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:05:58 2022] DELETE /identity/v3/projects/5b2b44d95eff408ab0bd9a23123f5158 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:58.194339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bf5cd-41eb-4299-9831-9ceb0ca98424 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.194628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bf5cd-41eb-4299-9831-9ceb0ca98424 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.194909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bf5cd-41eb-4299-9831-9ceb0ca98424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.237215 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-429bf5cd-41eb-4299-9831-9ceb0ca98424 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:58.238456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-429bf5cd-41eb-4299-9831-9ceb0ca98424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:58.304997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1301/2599] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:58.313669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170fe3-0ae5-407b-b03c-6b2463958db2 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.313927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170fe3-0ae5-407b-b03c-6b2463958db2 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.314266 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170fe3-0ae5-407b-b03c-6b2463958db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.333751 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c2170fe3-0ae5-407b-b03c-6b2463958db2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:58.334997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c2170fe3-0ae5-407b-b03c-6b2463958db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:58.345784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1299/2600] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:58.350485 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bf5cd-41eb-4299-9831-9ceb0ca98424 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:58.363185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bf5cd-41eb-4299-9831-9ceb0ca98424 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:58.371783 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98262ab8-9b4a-4622-8d08-a86fa028caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:58.372615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98262ab8-9b4a-4622-8d08-a86fa028caa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.372731 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98262ab8-9b4a-4622-8d08-a86fa028caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.372966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98262ab8-9b4a-4622-8d08-a86fa028caa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.373693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98262ab8-9b4a-4622-8d08-a86fa028caa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:05:58.374051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98262ab8-9b4a-4622-8d08-a86fa028caa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:58.375647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98262ab8-9b4a-4622-8d08-a86fa028caa8 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:58.388324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1302/2601] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:05:58.392912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170fe3-0ae5-407b-b03c-6b2463958db2 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:58.402595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170fe3-0ae5-407b-b03c-6b2463958db2 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:58.408879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadc51c-3380-4cd1-ae00-1a6e41d4ea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:58.409643 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadc51c-3380-4cd1-ae00-1a6e41d4ea53 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.409863 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadc51c-3380-4cd1-ae00-1a6e41d4ea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.410158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadc51c-3380-4cd1-ae00-1a6e41d4ea53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.410878 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadc51c-3380-4cd1-ae00-1a6e41d4ea53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:58.412813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadc51c-3380-4cd1-ae00-1a6e41d4ea53 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:58.441192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1300/2602] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:58 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:58.445433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98262ab8-9b4a-4622-8d08-a86fa028caa8 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:58.455687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98262ab8-9b4a-4622-8d08-a86fa028caa8 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:58.515149 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c545-b8e5-42f9-97fa-ae9e9f3bb42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:58.515864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c545-b8e5-42f9-97fa-ae9e9f3bb42c admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.516146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c545-b8e5-42f9-97fa-ae9e9f3bb42c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.516416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c545-b8e5-42f9-97fa-ae9e9f3bb42c admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.517151 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74c545-b8e5-42f9-97fa-ae9e9f3bb42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:58.519184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74c545-b8e5-42f9-97fa-ae9e9f3bb42c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:58.544229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1303/2603] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:58 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:58.548704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadc51c-3380-4cd1-ae00-1a6e41d4ea53 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:58.559529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadc51c-3380-4cd1-ae00-1a6e41d4ea53 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:58.565578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984032d5-2ea4-454c-a046-549b09e37829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:58.566283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984032d5-2ea4-454c-a046-549b09e37829 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.566561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984032d5-2ea4-454c-a046-549b09e37829 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.566833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984032d5-2ea4-454c-a046-549b09e37829 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.567555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984032d5-2ea4-454c-a046-549b09e37829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:58.569156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984032d5-2ea4-454c-a046-549b09e37829 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:58.580905 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1301/2604] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:05:58.585431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c545-b8e5-42f9-97fa-ae9e9f3bb42c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:58.596360 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c545-b8e5-42f9-97fa-ae9e9f3bb42c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:58.602975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8995d4-2743-450f-b0ac-291fce06436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:58.603635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8995d4-2743-450f-b0ac-291fce06436f admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.603926 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8995d4-2743-450f-b0ac-291fce06436f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.604195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8995d4-2743-450f-b0ac-291fce06436f admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.604896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8995d4-2743-450f-b0ac-291fce06436f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:58.606817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8995d4-2743-450f-b0ac-291fce06436f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:58.617696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1304/2605] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:58.622463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984032d5-2ea4-454c-a046-549b09e37829 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:58.632694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984032d5-2ea4-454c-a046-549b09e37829 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:58.637665 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667edb9-a08a-436c-a5bf-4ff59b48ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:58.638588 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667edb9-a08a-436c-a5bf-4ff59b48ea44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.638868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667edb9-a08a-436c-a5bf-4ff59b48ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.639145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667edb9-a08a-436c-a5bf-4ff59b48ea44 admin admin] PATH_INFO: `/v3/projects/d1d3dafef7824293802ef29be65e06b2/users/f490182f7e7743d8937a99855c48e702/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.654248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667edb9-a08a-436c-a5bf-4ff59b48ea44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3dafef7824293802ef29be65e06b2, user_id=f490182f7e7743d8937a99855c48e702, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:58.656911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667edb9-a08a-436c-a5bf-4ff59b48ea44 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:58.672710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1302/2606] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:58 2022] PUT /identity/v3/projects/d1d3dafef7824293802ef29be65e06b2/users/f490182f7e7743d8937a99855c48e702/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:58.684398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa20a1e-41d6-4554-bdde-977a4e910196 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.684687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa20a1e-41d6-4554-bdde-977a4e910196 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.684968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa20a1e-41d6-4554-bdde-977a4e910196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.716776 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-daa20a1e-41d6-4554-bdde-977a4e910196 None None] MFA Rules not processed for user `f490182f7e7743d8937a99855c48e702`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:58.718189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-daa20a1e-41d6-4554-bdde-977a4e910196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:58.785466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1305/2607] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:05:58.790369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667edb9-a08a-436c-a5bf-4ff59b48ea44 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:58.855808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667edb9-a08a-436c-a5bf-4ff59b48ea44 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:58.860832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d168dbb-c07a-42d1-864d-ffd90ed487fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:58.861493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168dbb-c07a-42d1-864d-ffd90ed487fe admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.861775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168dbb-c07a-42d1-864d-ffd90ed487fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.862086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168dbb-c07a-42d1-864d-ffd90ed487fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.862808 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168dbb-c07a-42d1-864d-ffd90ed487fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:58.864836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168dbb-c07a-42d1-864d-ffd90ed487fe admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:58.895353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1303/2608] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:05:58 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:58.900131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa20a1e-41d6-4554-bdde-977a4e910196 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:58.912325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa20a1e-41d6-4554-bdde-977a4e910196 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:58.971465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde681f-5f3a-438a-b461-3a7a1cacc3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:58.972141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde681f-5f3a-438a-b461-3a7a1cacc3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:58.972427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde681f-5f3a-438a-b461-3a7a1cacc3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:58.972701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde681f-5f3a-438a-b461-3a7a1cacc3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:58.973395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde681f-5f3a-438a-b461-3a7a1cacc3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:58.975344 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde681f-5f3a-438a-b461-3a7a1cacc3e9 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:58.996502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1306/2609] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:05:58 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:05:59.000684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d168dbb-c07a-42d1-864d-ffd90ed487fe admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:59.011074 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d168dbb-c07a-42d1-864d-ffd90ed487fe admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:59.016076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bbdcb-093e-4801-8f4e-d93f109eedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:59.016743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bbdcb-093e-4801-8f4e-d93f109eedf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:59.017054 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bbdcb-093e-4801-8f4e-d93f109eedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:59.017330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bbdcb-093e-4801-8f4e-d93f109eedf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:59.018092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bbdcb-093e-4801-8f4e-d93f109eedf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:59.019705 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bbdcb-093e-4801-8f4e-d93f109eedf9 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:59.030577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1304/2610] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:59.034795 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde681f-5f3a-438a-b461-3a7a1cacc3e9 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:59.044816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde681f-5f3a-438a-b461-3a7a1cacc3e9 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:59.049424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0cf4d-0bb1-465b-96f9-e7fefc3caf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:59.050352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0cf4d-0bb1-465b-96f9-e7fefc3caf70 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:59.050630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0cf4d-0bb1-465b-96f9-e7fefc3caf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:59.050904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0cf4d-0bb1-465b-96f9-e7fefc3caf70 admin admin] PATH_INFO: `/v3/projects/ff7f0ed3350642a5a30df840be135f76/users/049e34538346415680293bdd93fa4db0/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:59.066717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0cf4d-0bb1-465b-96f9-e7fefc3caf70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7f0ed3350642a5a30df840be135f76, user_id=049e34538346415680293bdd93fa4db0, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:59.069375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0cf4d-0bb1-465b-96f9-e7fefc3caf70 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:59.084842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1307/2611] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:59 2022] PUT /identity/v3/projects/ff7f0ed3350642a5a30df840be135f76/users/049e34538346415680293bdd93fa4db0/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:59.088923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bbdcb-093e-4801-8f4e-d93f109eedf9 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:59.099713 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bbdcb-093e-4801-8f4e-d93f109eedf9 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:59.159293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33b20d-e833-4fc3-8263-73a818745cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:59.160058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33b20d-e833-4fc3-8263-73a818745cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:59.160346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33b20d-e833-4fc3-8263-73a818745cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:59.160621 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33b20d-e833-4fc3-8263-73a818745cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:59.161342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33b20d-e833-4fc3-8263-73a818745cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:59.162979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33b20d-e833-4fc3-8263-73a818745cc5 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:59.175343 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1305/2612] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:05:59.179684 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0cf4d-0bb1-465b-96f9-e7fefc3caf70 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:59.193802 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0cf4d-0bb1-465b-96f9-e7fefc3caf70 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:59.198692 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc36cb-327a-444d-a836-a48857ac3125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:59.199990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc36cb-327a-444d-a836-a48857ac3125 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:59.200274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc36cb-327a-444d-a836-a48857ac3125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:59.200557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc36cb-327a-444d-a836-a48857ac3125 admin admin] PATH_INFO: `/v3/projects/ff7f0ed3350642a5a30df840be135f76/users/049e34538346415680293bdd93fa4db0/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:59.202677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc36cb-327a-444d-a836-a48857ac3125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7f0ed3350642a5a30df840be135f76, user_id=049e34538346415680293bdd93fa4db0, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:59.212848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc36cb-327a-444d-a836-a48857ac3125 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:59.219052 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1308/2613] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:05:59 2022] PUT /identity/v3/projects/ff7f0ed3350642a5a30df840be135f76/users/049e34538346415680293bdd93fa4db0/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:05:59.229926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e744b47-34e7-4dde-a29e-37f0394d2a0f None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:59.230305 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e744b47-34e7-4dde-a29e-37f0394d2a0f None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:59.230738 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e744b47-34e7-4dde-a29e-37f0394d2a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:59.267028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-1e744b47-34e7-4dde-a29e-37f0394d2a0f None None] MFA Rules not processed for user `049e34538346415680293bdd93fa4db0`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:05:59.268253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1e744b47-34e7-4dde-a29e-37f0394d2a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:59.341340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1306/2614] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:05:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:05:59.356727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc36cb-327a-444d-a836-a48857ac3125 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:59.358700 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-49cc36cb-327a-444d-a836-a48857ac3125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:05:59.419788 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc36cb-327a-444d-a836-a48857ac3125 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:59.424076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70feae-0baa-41ae-ab58-4b2f795c1f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:59.424722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70feae-0baa-41ae-ab58-4b2f795c1f46 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:59.425000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70feae-0baa-41ae-ab58-4b2f795c1f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:59.425274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70feae-0baa-41ae-ab58-4b2f795c1f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:59.435735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70feae-0baa-41ae-ab58-4b2f795c1f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:59.437860 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70feae-0baa-41ae-ab58-4b2f795c1f46 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:05:59.451568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1309/2615] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:05:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:05:59.859803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e744b47-34e7-4dde-a29e-37f0394d2a0f None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:05:59.935572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e744b47-34e7-4dde-a29e-37f0394d2a0f None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:05:59.943251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:05:59.944421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:05:59.944826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:05:59.945203 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] PATH_INFO: `/v3/users/f490182f7e7743d8937a99855c48e702` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:05:59.947056 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f490182f7e7743d8937a99855c48e702)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:05:59.949882 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:00.000033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f490182f7e7743d8937a99855c48e702'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.014006 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f490182f7e7743d8937a99855c48e702'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.022245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f490182f7e7743d8937a99855c48e702'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.022858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f490182f7e7743d8937a99855c48e702'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.030257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f490182f7e7743d8937a99855c48e702'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.036220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1307/2616] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:05:59 2022] DELETE /identity/v3/users/f490182f7e7743d8937a99855c48e702 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:00.040990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ad861-7b66-4dd3-b255-1fd9766163ff None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:00.041520 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ad861-7b66-4dd3-b255-1fd9766163ff None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:00.041648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ad861-7b66-4dd3-b255-1fd9766163ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:00.060218 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-735ad861-7b66-4dd3-b255-1fd9766163ff None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:00.061434 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-735ad861-7b66-4dd3-b255-1fd9766163ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:00.122480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1310/2617] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:00.133050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:00.134778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:00.193635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c114f-7c6b-43ef-8dd0-86dbe1f9963c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:00.198271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b19f26-ab06-4131-8110-0d8b5f49a9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:00.198927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b19f26-ab06-4131-8110-0d8b5f49a9db service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:00.199212 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b19f26-ab06-4131-8110-0d8b5f49a9db service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:00.199639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b19f26-ab06-4131-8110-0d8b5f49a9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:00.209765 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b19f26-ab06-4131-8110-0d8b5f49a9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:00.211253 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b19f26-ab06-4131-8110-0d8b5f49a9db service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:00.221982 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1308/2618] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:06:00.507197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ad861-7b66-4dd3-b255-1fd9766163ff None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:00.509144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-735ad861-7b66-4dd3-b255-1fd9766163ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:00.525592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ad861-7b66-4dd3-b255-1fd9766163ff None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:00.531717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:00.534894 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:00.535687 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:00.535914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] PATH_INFO: `/v3/projects/d1d3dafef7824293802ef29be65e06b2` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:00.537442 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d3dafef7824293802ef29be65e06b2)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:00.539609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:00.586607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d3dafef7824293802ef29be65e06b2', 'request_id': 'req-df26428d-5154-42cf-ac4d-402ab7958f2a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.592516 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d3dafef7824293802ef29be65e06b2', 'request_id': 'req-df26428d-5154-42cf-ac4d-402ab7958f2a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.598772 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d3dafef7824293802ef29be65e06b2', 'request_id': 'req-df26428d-5154-42cf-ac4d-402ab7958f2a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.612270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] The token cache is being invalidate because project d1d3dafef7824293802ef29be65e06b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:06:00.612570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.613274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.617993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1311/2619] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:06:00 2022] DELETE /identity/v3/projects/d1d3dafef7824293802ef29be65e06b2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:00.621715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b19f26-ab06-4131-8110-0d8b5f49a9db service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:00.632320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b19f26-ab06-4131-8110-0d8b5f49a9db service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:00.690419 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:00.691294 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:00.691575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:00.691848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] PATH_INFO: `/v3/users/049e34538346415680293bdd93fa4db0` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:00.693021 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=049e34538346415680293bdd93fa4db0)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:00.695013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:00.745140 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049e34538346415680293bdd93fa4db0'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.756949 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049e34538346415680293bdd93fa4db0'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.765528 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049e34538346415680293bdd93fa4db0'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.766180 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049e34538346415680293bdd93fa4db0'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.773561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-13a7dcde-2080-40a8-988a-525d46c06b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049e34538346415680293bdd93fa4db0'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:00.779682 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1309/2620] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:06:00 2022] DELETE /identity/v3/users/049e34538346415680293bdd93fa4db0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:01.069847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:01.071510 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:01.086569 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26428d-5154-42cf-ac4d-402ab7958f2a admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:01.146290 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:01.147160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.147432 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.147710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] PATH_INFO: `/v3/projects/ff7f0ed3350642a5a30df840be135f76` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.149170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7f0ed3350642a5a30df840be135f76)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:01.151135 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:01.208368 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7f0ed3350642a5a30df840be135f76', 'request_id': 'req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:01.213864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7f0ed3350642a5a30df840be135f76', 'request_id': 'req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:01.220929 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7f0ed3350642a5a30df840be135f76', 'request_id': 'req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:01.235496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] The token cache is being invalidate because project ff7f0ed3350642a5a30df840be135f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:06:01.235782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:01.236382 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7d49f9b5-0057-47f2-a2dd-ac5489d4d90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:01.237964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1312/2621] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:06:01 2022] DELETE /identity/v3/projects/ff7f0ed3350642a5a30df840be135f76 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:01.242945 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3281a2-5f15-47d4-8eda-9446cefc30db None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.243449 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3281a2-5f15-47d4-8eda-9446cefc30db None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.243545 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3281a2-5f15-47d4-8eda-9446cefc30db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.262707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-4c3281a2-5f15-47d4-8eda-9446cefc30db None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:01.263817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4c3281a2-5f15-47d4-8eda-9446cefc30db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:01.328337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1310/2622] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:01.336249 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ff9f3-2aa4-41a4-8834-88116f5d3cf6 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.336537 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ff9f3-2aa4-41a4-8834-88116f5d3cf6 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.336812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ff9f3-2aa4-41a4-8834-88116f5d3cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.356568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-946ff9f3-2aa4-41a4-8834-88116f5d3cf6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:01.357799 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-946ff9f3-2aa4-41a4-8834-88116f5d3cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:01.366336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1313/2623] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:01.371403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3281a2-5f15-47d4-8eda-9446cefc30db None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:01.387354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3281a2-5f15-47d4-8eda-9446cefc30db None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:01.391996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f37f20-eab8-48fc-8b1d-00a38f27c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:01.392663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f37f20-eab8-48fc-8b1d-00a38f27c9ce admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.392946 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f37f20-eab8-48fc-8b1d-00a38f27c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.393223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f37f20-eab8-48fc-8b1d-00a38f27c9ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.393969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f37f20-eab8-48fc-8b1d-00a38f27c9ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:06:01.394288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f37f20-eab8-48fc-8b1d-00a38f27c9ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:01.395900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f37f20-eab8-48fc-8b1d-00a38f27c9ce admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:01.408893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1311/2624] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:06:01.413453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ff9f3-2aa4-41a4-8834-88116f5d3cf6 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:01.423563 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ff9f3-2aa4-41a4-8834-88116f5d3cf6 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:01.429248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35973497-3ca0-45a7-bd35-3c8189624109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:01.429905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35973497-3ca0-45a7-bd35-3c8189624109 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.430216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35973497-3ca0-45a7-bd35-3c8189624109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.430494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35973497-3ca0-45a7-bd35-3c8189624109 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.431192 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35973497-3ca0-45a7-bd35-3c8189624109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:01.433101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35973497-3ca0-45a7-bd35-3c8189624109 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:01.464281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1314/2625] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:06:01 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:06:01.468887 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f37f20-eab8-48fc-8b1d-00a38f27c9ce admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:01.479175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f37f20-eab8-48fc-8b1d-00a38f27c9ce admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:01.541182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426de6fa-a720-4c7c-8001-119f8f9054de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:01.541758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426de6fa-a720-4c7c-8001-119f8f9054de admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.542061 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426de6fa-a720-4c7c-8001-119f8f9054de admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.542340 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426de6fa-a720-4c7c-8001-119f8f9054de admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.543031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426de6fa-a720-4c7c-8001-119f8f9054de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:01.545610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426de6fa-a720-4c7c-8001-119f8f9054de admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:01.567182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1312/2626] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:06:01 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:06:01.571678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35973497-3ca0-45a7-bd35-3c8189624109 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:01.582652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35973497-3ca0-45a7-bd35-3c8189624109 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:01.587561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819fd91-9f9c-42b5-ac1a-da3dee5cdddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:01.588234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819fd91-9f9c-42b5-ac1a-da3dee5cdddc admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.588491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819fd91-9f9c-42b5-ac1a-da3dee5cdddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.588785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819fd91-9f9c-42b5-ac1a-da3dee5cdddc admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.589496 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819fd91-9f9c-42b5-ac1a-da3dee5cdddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:01.591693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819fd91-9f9c-42b5-ac1a-da3dee5cdddc admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:01.602268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1315/2627] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:01.606840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426de6fa-a720-4c7c-8001-119f8f9054de admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:01.619276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426de6fa-a720-4c7c-8001-119f8f9054de admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:01.626880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff68ca7-e256-4f57-bbbf-543492aece91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:01.627811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff68ca7-e256-4f57-bbbf-543492aece91 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.628170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff68ca7-e256-4f57-bbbf-543492aece91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.628588 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff68ca7-e256-4f57-bbbf-543492aece91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.629609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff68ca7-e256-4f57-bbbf-543492aece91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:01.632026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff68ca7-e256-4f57-bbbf-543492aece91 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:01.644533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1313/2628] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:01.648960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819fd91-9f9c-42b5-ac1a-da3dee5cdddc admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:01.661337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819fd91-9f9c-42b5-ac1a-da3dee5cdddc admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:01.669463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9e58a-e31d-408f-ae62-0ba5ad2d47a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:01.670457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9e58a-e31d-408f-ae62-0ba5ad2d47a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.670717 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9e58a-e31d-408f-ae62-0ba5ad2d47a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.670987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9e58a-e31d-408f-ae62-0ba5ad2d47a6 admin admin] PATH_INFO: `/v3/projects/a1a87979cb534ea9b5e74c34b1567ae3/users/9262bd19c1d94ab8b6577ac460374fa8/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.687658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9e58a-e31d-408f-ae62-0ba5ad2d47a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a87979cb534ea9b5e74c34b1567ae3, user_id=9262bd19c1d94ab8b6577ac460374fa8, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:01.690348 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9e58a-e31d-408f-ae62-0ba5ad2d47a6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:01.707773 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1316/2629] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:06:01 2022] PUT /identity/v3/projects/a1a87979cb534ea9b5e74c34b1567ae3/users/9262bd19c1d94ab8b6577ac460374fa8/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:01.718699 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42360e-e43a-4f66-88f4-3da56871f2ed None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.718990 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42360e-e43a-4f66-88f4-3da56871f2ed None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.719293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42360e-e43a-4f66-88f4-3da56871f2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.746172 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-7a42360e-e43a-4f66-88f4-3da56871f2ed None None] MFA Rules not processed for user `9262bd19c1d94ab8b6577ac460374fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:01.747484 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-7a42360e-e43a-4f66-88f4-3da56871f2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:01.813284 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1314/2630] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:01.817930 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9e58a-e31d-408f-ae62-0ba5ad2d47a6 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:01.884663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9e58a-e31d-408f-ae62-0ba5ad2d47a6 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:01.889992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77851da0-dfd0-4f46-b1a8-c7666f192f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:01.890690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851da0-dfd0-4f46-b1a8-c7666f192f71 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:01.890975 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851da0-dfd0-4f46-b1a8-c7666f192f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:01.891253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851da0-dfd0-4f46-b1a8-c7666f192f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:01.891963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77851da0-dfd0-4f46-b1a8-c7666f192f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:01.895535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77851da0-dfd0-4f46-b1a8-c7666f192f71 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:01.934460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1317/2631] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:06:01 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:06:01.935678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42360e-e43a-4f66-88f4-3da56871f2ed None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:01.946735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42360e-e43a-4f66-88f4-3da56871f2ed None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:02.010190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acaf56-4647-4329-a789-4bf6b010a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:02.010874 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acaf56-4647-4329-a789-4bf6b010a5cf admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:02.011161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acaf56-4647-4329-a789-4bf6b010a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:02.011439 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acaf56-4647-4329-a789-4bf6b010a5cf admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:02.012355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acaf56-4647-4329-a789-4bf6b010a5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:02.014350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acaf56-4647-4329-a789-4bf6b010a5cf admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:02.035139 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1315/2632] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:06:01 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:06:02.039307 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77851da0-dfd0-4f46-b1a8-c7666f192f71 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:02.049886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77851da0-dfd0-4f46-b1a8-c7666f192f71 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:02.055461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aea541-32fb-4441-b0a1-076a59db4ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:02.056128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aea541-32fb-4441-b0a1-076a59db4ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:02.056411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aea541-32fb-4441-b0a1-076a59db4ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:02.056689 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aea541-32fb-4441-b0a1-076a59db4ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:02.057417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aea541-32fb-4441-b0a1-076a59db4ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:02.059247 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aea541-32fb-4441-b0a1-076a59db4ca1 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:02.070623 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1318/2633] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:02.075610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acaf56-4647-4329-a789-4bf6b010a5cf admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:02.087400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acaf56-4647-4329-a789-4bf6b010a5cf admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:02.093034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640a685-9264-4a67-9a9a-77342bdd36d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:02.094014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640a685-9264-4a67-9a9a-77342bdd36d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:02.094335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640a685-9264-4a67-9a9a-77342bdd36d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:02.094779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640a685-9264-4a67-9a9a-77342bdd36d2 admin admin] PATH_INFO: `/v3/projects/90705e8ce4ca49e391dad85c524aa556/users/716aef5bf1a847879d5fb0b2de09f6bc/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:02.114540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640a685-9264-4a67-9a9a-77342bdd36d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90705e8ce4ca49e391dad85c524aa556, user_id=716aef5bf1a847879d5fb0b2de09f6bc, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:02.117440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640a685-9264-4a67-9a9a-77342bdd36d2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:02.132177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1316/2634] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:06:02 2022] PUT /identity/v3/projects/90705e8ce4ca49e391dad85c524aa556/users/716aef5bf1a847879d5fb0b2de09f6bc/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:06:02.136258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aea541-32fb-4441-b0a1-076a59db4ca1 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:02.146882 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aea541-32fb-4441-b0a1-076a59db4ca1 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:02.217954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae843a-aedc-4fe3-87ae-6a2911cd7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:02.218634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae843a-aedc-4fe3-87ae-6a2911cd7f7f admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:02.218912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae843a-aedc-4fe3-87ae-6a2911cd7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:02.219178 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae843a-aedc-4fe3-87ae-6a2911cd7f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:02.219932 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae843a-aedc-4fe3-87ae-6a2911cd7f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:02.221581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae843a-aedc-4fe3-87ae-6a2911cd7f7f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:02.232414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1319/2635] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:06:02.236849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640a685-9264-4a67-9a9a-77342bdd36d2 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:02.249323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640a685-9264-4a67-9a9a-77342bdd36d2 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:02.255106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23e5d-2344-4ba7-a862-ca53c91e91b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:02.255997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23e5d-2344-4ba7-a862-ca53c91e91b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:02.256275 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23e5d-2344-4ba7-a862-ca53c91e91b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:02.256544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23e5d-2344-4ba7-a862-ca53c91e91b6 admin admin] PATH_INFO: `/v3/projects/90705e8ce4ca49e391dad85c524aa556/users/716aef5bf1a847879d5fb0b2de09f6bc/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:02.258687 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df23e5d-2344-4ba7-a862-ca53c91e91b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90705e8ce4ca49e391dad85c524aa556, user_id=716aef5bf1a847879d5fb0b2de09f6bc, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:02.261320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df23e5d-2344-4ba7-a862-ca53c91e91b6 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:02.273822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1317/2636] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:06:02 2022] PUT /identity/v3/projects/90705e8ce4ca49e391dad85c524aa556/users/716aef5bf1a847879d5fb0b2de09f6bc/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:02.289635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432400f-0654-43fe-b726-5a178b95d435 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:02.289919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432400f-0654-43fe-b726-5a178b95d435 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:02.290236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432400f-0654-43fe-b726-5a178b95d435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:02.318470 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-8432400f-0654-43fe-b726-5a178b95d435 None None] MFA Rules not processed for user `716aef5bf1a847879d5fb0b2de09f6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:02.319660 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8432400f-0654-43fe-b726-5a178b95d435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:02.402605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1320/2637] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:06:02.414798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23e5d-2344-4ba7-a862-ca53c91e91b6 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:02.416955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-4df23e5d-2344-4ba7-a862-ca53c91e91b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:02.479199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23e5d-2344-4ba7-a862-ca53c91e91b6 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:02.485193 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5a5c-1e92-4901-bd43-eb1cf27d1681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:02.485969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5a5c-1e92-4901-bd43-eb1cf27d1681 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:02.486503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5a5c-1e92-4901-bd43-eb1cf27d1681 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:02.486846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5a5c-1e92-4901-bd43-eb1cf27d1681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:02.497402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5a5c-1e92-4901-bd43-eb1cf27d1681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:02.499184 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5a5c-1e92-4901-bd43-eb1cf27d1681 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:02.509558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1318/2638] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:02 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:06:02.953428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432400f-0654-43fe-b726-5a178b95d435 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:03.020808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432400f-0654-43fe-b726-5a178b95d435 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:03.026048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:03.027006 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:03.027216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:03.027570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] PATH_INFO: `/v3/users/9262bd19c1d94ab8b6577ac460374fa8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:03.028888 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9262bd19c1d94ab8b6577ac460374fa8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:03.030855 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:03.082720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9262bd19c1d94ab8b6577ac460374fa8'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.083424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9262bd19c1d94ab8b6577ac460374fa8'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.084106 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9262bd19c1d94ab8b6577ac460374fa8'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.093234 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9262bd19c1d94ab8b6577ac460374fa8'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.100374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9262bd19c1d94ab8b6577ac460374fa8'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.121281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1321/2639] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:06:02 2022] DELETE /identity/v3/users/9262bd19c1d94ab8b6577ac460374fa8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:03.122564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf49f25-7147-49bd-80ad-88bd601e2f83 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:03.123237 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf49f25-7147-49bd-80ad-88bd601e2f83 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:03.123496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf49f25-7147-49bd-80ad-88bd601e2f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:03.142261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-fcf49f25-7147-49bd-80ad-88bd601e2f83 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:03.143480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fcf49f25-7147-49bd-80ad-88bd601e2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:03.206717 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1319/2640] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:03.217141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:03.218667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:03.279433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736493b4-44f6-411f-9c1d-7b355f7373f1 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:03.283657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b582e-edfc-4405-8e18-9a69ce28688d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:03.284305 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b582e-edfc-4405-8e18-9a69ce28688d service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:03.284581 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b582e-edfc-4405-8e18-9a69ce28688d service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:03.284851 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b582e-edfc-4405-8e18-9a69ce28688d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:03.294655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b582e-edfc-4405-8e18-9a69ce28688d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:03.296085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b582e-edfc-4405-8e18-9a69ce28688d service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:03.305908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1322/2641] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:06:03.592915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf49f25-7147-49bd-80ad-88bd601e2f83 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:03.594583 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-fcf49f25-7147-49bd-80ad-88bd601e2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:03.606679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf49f25-7147-49bd-80ad-88bd601e2f83 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:03.611789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:03.612686 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:03.612921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:03.613189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] PATH_INFO: `/v3/projects/a1a87979cb534ea9b5e74c34b1567ae3` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:03.614968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a87979cb534ea9b5e74c34b1567ae3)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:03.616894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:03.665051 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a87979cb534ea9b5e74c34b1567ae3', 'request_id': 'req-d4a2fa65-b721-443d-85ff-b8283365e148'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.670496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a87979cb534ea9b5e74c34b1567ae3', 'request_id': 'req-d4a2fa65-b721-443d-85ff-b8283365e148'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.683243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a87979cb534ea9b5e74c34b1567ae3', 'request_id': 'req-d4a2fa65-b721-443d-85ff-b8283365e148'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.696568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] The token cache is being invalidate because project a1a87979cb534ea9b5e74c34b1567ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:06:03.696746 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.697464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.699273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1320/2642] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:06:03 2022] DELETE /identity/v3/projects/a1a87979cb534ea9b5e74c34b1567ae3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:03.704432 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b582e-edfc-4405-8e18-9a69ce28688d service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:03.714499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b582e-edfc-4405-8e18-9a69ce28688d service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:03.776584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:03.777502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:03.777785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:03.778092 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] PATH_INFO: `/v3/users/716aef5bf1a847879d5fb0b2de09f6bc` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:03.779431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716aef5bf1a847879d5fb0b2de09f6bc)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:03.781477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:03.829879 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716aef5bf1a847879d5fb0b2de09f6bc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.830614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716aef5bf1a847879d5fb0b2de09f6bc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.831230 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716aef5bf1a847879d5fb0b2de09f6bc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.841922 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716aef5bf1a847879d5fb0b2de09f6bc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.849312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40dfb8b7-1869-4fd0-84e2-d6e69fef4be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716aef5bf1a847879d5fb0b2de09f6bc'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:03.868033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1323/2643] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:06:03 2022] DELETE /identity/v3/users/716aef5bf1a847879d5fb0b2de09f6bc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:04.156503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:04.158034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:04.172291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2fa65-b721-443d-85ff-b8283365e148 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:04.232711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:04.233502 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.233784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.234104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] PATH_INFO: `/v3/projects/90705e8ce4ca49e391dad85c524aa556` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.235323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90705e8ce4ca49e391dad85c524aa556)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:04.237260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:04.286877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90705e8ce4ca49e391dad85c524aa556', 'request_id': 'req-97223086-d0ca-4d2b-b681-3ece56896148'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:04.292509 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90705e8ce4ca49e391dad85c524aa556', 'request_id': 'req-97223086-d0ca-4d2b-b681-3ece56896148'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:04.301363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90705e8ce4ca49e391dad85c524aa556', 'request_id': 'req-97223086-d0ca-4d2b-b681-3ece56896148'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:04.313071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] The token cache is being invalidate because project 90705e8ce4ca49e391dad85c524aa556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:06:04.313358 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:04.314163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-97223086-d0ca-4d2b-b681-3ece56896148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:04.315775 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1321/2644] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:06:04 2022] DELETE /identity/v3/projects/90705e8ce4ca49e391dad85c524aa556 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:04.322036 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a2623-68bd-41b4-a604-cb76d67f8c19 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.322518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a2623-68bd-41b4-a604-cb76d67f8c19 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.322634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a2623-68bd-41b4-a604-cb76d67f8c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.355574 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-7e3a2623-68bd-41b4-a604-cb76d67f8c19 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:04.357205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7e3a2623-68bd-41b4-a604-cb76d67f8c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:04.438194 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1324/2645] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:04.450669 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea3f10-8eab-4b14-a416-b6dc9b434b18 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.450928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea3f10-8eab-4b14-a416-b6dc9b434b18 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.451225 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea3f10-8eab-4b14-a416-b6dc9b434b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.471893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-48ea3f10-8eab-4b14-a416-b6dc9b434b18 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:04.473113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-48ea3f10-8eab-4b14-a416-b6dc9b434b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:04.482464 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1322/2646] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:04.487033 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a2623-68bd-41b4-a604-cb76d67f8c19 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:04.496695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a2623-68bd-41b4-a604-cb76d67f8c19 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:04.501970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6427d53-e4c8-455a-bec9-1e1767df969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:04.502620 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427d53-e4c8-455a-bec9-1e1767df969e admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.502909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427d53-e4c8-455a-bec9-1e1767df969e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.503180 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427d53-e4c8-455a-bec9-1e1767df969e admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.503911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6427d53-e4c8-455a-bec9-1e1767df969e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:06:04.504219 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6427d53-e4c8-455a-bec9-1e1767df969e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:04.505852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6427d53-e4c8-455a-bec9-1e1767df969e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:04.518799 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1325/2647] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:06:04.523463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea3f10-8eab-4b14-a416-b6dc9b434b18 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:04.533556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea3f10-8eab-4b14-a416-b6dc9b434b18 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:04.539486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc0ddb-6015-4010-bb36-00e32a74a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:04.540138 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc0ddb-6015-4010-bb36-00e32a74a228 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.540418 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc0ddb-6015-4010-bb36-00e32a74a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.540688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc0ddb-6015-4010-bb36-00e32a74a228 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.541380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc0ddb-6015-4010-bb36-00e32a74a228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:04.543517 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc0ddb-6015-4010-bb36-00e32a74a228 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:04.573957 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1323/2648] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:06:04 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:06:04.577862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6427d53-e4c8-455a-bec9-1e1767df969e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:04.588517 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6427d53-e4c8-455a-bec9-1e1767df969e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:04.652812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b4896-0ef4-47c3-8736-03e99fb41c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:04.653688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b4896-0ef4-47c3-8736-03e99fb41c04 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.654102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b4896-0ef4-47c3-8736-03e99fb41c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.654414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b4896-0ef4-47c3-8736-03e99fb41c04 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.655207 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b4896-0ef4-47c3-8736-03e99fb41c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:04.657268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b4896-0ef4-47c3-8736-03e99fb41c04 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:04.682405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1326/2649] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:06:04 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:06:04.687270 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc0ddb-6015-4010-bb36-00e32a74a228 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:04.700702 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc0ddb-6015-4010-bb36-00e32a74a228 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:04.705742 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c2817-36a8-424d-bc70-24c21d4fc2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:04.706524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2817-36a8-424d-bc70-24c21d4fc2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.706878 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2817-36a8-424d-bc70-24c21d4fc2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.707249 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c2817-36a8-424d-bc70-24c21d4fc2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.708041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c2817-36a8-424d-bc70-24c21d4fc2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:04.709908 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c2817-36a8-424d-bc70-24c21d4fc2d6 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:04.721564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1324/2650] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:04.726050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b4896-0ef4-47c3-8736-03e99fb41c04 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:04.736852 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b4896-0ef4-47c3-8736-03e99fb41c04 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:04.742243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3ef9b-36bd-4950-a0e7-c8b740d1e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:04.742833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3ef9b-36bd-4950-a0e7-c8b740d1e938 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.743118 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3ef9b-36bd-4950-a0e7-c8b740d1e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.743396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3ef9b-36bd-4950-a0e7-c8b740d1e938 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.745641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3ef9b-36bd-4950-a0e7-c8b740d1e938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:04.751202 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3ef9b-36bd-4950-a0e7-c8b740d1e938 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:04.767216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1327/2651] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:04.769107 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c2817-36a8-424d-bc70-24c21d4fc2d6 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:04.779568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c2817-36a8-424d-bc70-24c21d4fc2d6 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:04.784977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7a07-9f7c-4b2b-8114-c0c2eb94f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:04.786033 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7a07-9f7c-4b2b-8114-c0c2eb94f3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.786380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7a07-9f7c-4b2b-8114-c0c2eb94f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.786721 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab7a07-9f7c-4b2b-8114-c0c2eb94f3f1 admin admin] PATH_INFO: `/v3/projects/5d4fac71b40b449488b751ae1759a917/users/caa282313a4247cca8305b8ce768eb20/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.802233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab7a07-9f7c-4b2b-8114-c0c2eb94f3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4fac71b40b449488b751ae1759a917, user_id=caa282313a4247cca8305b8ce768eb20, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:04.805000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab7a07-9f7c-4b2b-8114-c0c2eb94f3f1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:04.822987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1325/2652] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:06:04 2022] PUT /identity/v3/projects/5d4fac71b40b449488b751ae1759a917/users/caa282313a4247cca8305b8ce768eb20/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:04.825684 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a72460-0cc6-4ab8-b466-d69bbdfb71c3 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.825990 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a72460-0cc6-4ab8-b466-d69bbdfb71c3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:04.826262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a72460-0cc6-4ab8-b466-d69bbdfb71c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:04.850354 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-c5a72460-0cc6-4ab8-b466-d69bbdfb71c3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:04.851598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c5a72460-0cc6-4ab8-b466-d69bbdfb71c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:04.916599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1328/2653] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:04.927459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7a07-9f7c-4b2b-8114-c0c2eb94f3f1 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:04.929349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ecab7a07-9f7c-4b2b-8114-c0c2eb94f3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:04.989679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab7a07-9f7c-4b2b-8114-c0c2eb94f3f1 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:04.998965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0a9aa-2de3-4939-922b-32e873d0ab92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:04.999562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0a9aa-2de3-4939-922b-32e873d0ab92 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:04.999846 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0a9aa-2de3-4939-922b-32e873d0ab92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:05.000326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0a9aa-2de3-4939-922b-32e873d0ab92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:05.010888 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0a9aa-2de3-4939-922b-32e873d0ab92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:05.012489 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0a9aa-2de3-4939-922b-32e873d0ab92 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:05.022292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1326/2654] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:06:05.735629 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eede60-cf4d-4b67-bba0-1f9647ee5d90 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:05.736183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eede60-cf4d-4b67-bba0-1f9647ee5d90 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:05.736183 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eede60-cf4d-4b67-bba0-1f9647ee5d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:05.763676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-83eede60-cf4d-4b67-bba0-1f9647ee5d90 None None] MFA Rules not processed for user `caa282313a4247cca8305b8ce768eb20`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:05.764830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-83eede60-cf4d-4b67-bba0-1f9647ee5d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:05.817534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0a9aa-2de3-4939-922b-32e873d0ab92 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:05.819901 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c9f0a9aa-2de3-4939-922b-32e873d0ab92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:05.839266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1329/2655] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:05.847985 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0a9aa-2de3-4939-922b-32e873d0ab92 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:05.851649 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eede60-cf4d-4b67-bba0-1f9647ee5d90 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:05.853116 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-83eede60-cf4d-4b67-bba0-1f9647ee5d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:05.855871 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:05.856761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:05.857043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:05.857317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] PATH_INFO: `/v3/users/b3b2a3e4592343a9a293dc2500348025` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:05.858584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b2a3e4592343a9a293dc2500348025)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:05.860604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:05.917186 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eede60-cf4d-4b67-bba0-1f9647ee5d90 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:05.922171 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806205e-99d5-4373-928f-ebacfd39de72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:05.922821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806205e-99d5-4373-928f-ebacfd39de72 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:05.923268 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806205e-99d5-4373-928f-ebacfd39de72 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:05.923730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806205e-99d5-4373-928f-ebacfd39de72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:05.929205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b2a3e4592343a9a293dc2500348025'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:05.936204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806205e-99d5-4373-928f-ebacfd39de72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:05.937667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806205e-99d5-4373-928f-ebacfd39de72 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:05.946485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b2a3e4592343a9a293dc2500348025'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:05.947547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1330/2656] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:06:05.963697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b2a3e4592343a9a293dc2500348025'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:05.964556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b2a3e4592343a9a293dc2500348025'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:05.972749 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b2a3e4592343a9a293dc2500348025'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:05.978943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1327/2657] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:06:05 2022] DELETE /identity/v3/users/b3b2a3e4592343a9a293dc2500348025 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:06:06.160258 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806205e-99d5-4373-928f-ebacfd39de72 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:06.188209 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806205e-99d5-4373-928f-ebacfd39de72 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:06.253752 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:06.254819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:06.255682 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:06.255968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] PATH_INFO: `/v3/projects/31c79632b12442e5aa14e4a4c9c02441` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:06.257189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c79632b12442e5aa14e4a4c9c02441)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:06.259270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:06.310984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c79632b12442e5aa14e4a4c9c02441', 'request_id': 'req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.316405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c79632b12442e5aa14e4a4c9c02441', 'request_id': 'req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.322974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c79632b12442e5aa14e4a4c9c02441', 'request_id': 'req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.338196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] The token cache is being invalidate because project 31c79632b12442e5aa14e4a4c9c02441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:06:06.338577 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.339403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.341842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1331/2658] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:06:06 2022] DELETE /identity/v3/projects/31c79632b12442e5aa14e4a4c9c02441 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:06.346097 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:06.347860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:06.362557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf25f8-396a-4279-b649-1a29a4e69089 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:06.425840 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:06.426777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:06.427055 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:06.427329 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] PATH_INFO: `/v3/users/6e190cc6a574465f83a493a0649a735d` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:06.428535 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e190cc6a574465f83a493a0649a735d)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:06.430500 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:06.480134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e190cc6a574465f83a493a0649a735d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.492932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e190cc6a574465f83a493a0649a735d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.501314 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e190cc6a574465f83a493a0649a735d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.502164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e190cc6a574465f83a493a0649a735d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.509885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-a3c0f9da-e6d4-49c3-9b49-a19a9aa38423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e190cc6a574465f83a493a0649a735d'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.517430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1328/2659] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:06:06 2022] DELETE /identity/v3/users/6e190cc6a574465f83a493a0649a735d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:06.711622 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:06.713304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:06.727102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6c1cd-a40d-44c8-a960-1226efbfbb6f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:06.789177 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:06.790196 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:06.790482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:06.790757 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] PATH_INFO: `/v3/projects/53b17c8a25c34d4683b3763ee9a9d60d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:06.792064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b17c8a25c34d4683b3763ee9a9d60d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:06.794094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:06.845561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b17c8a25c34d4683b3763ee9a9d60d', 'request_id': 'req-692ed947-4afd-46df-bdb2-edc151b1f9c3'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.854463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b17c8a25c34d4683b3763ee9a9d60d', 'request_id': 'req-692ed947-4afd-46df-bdb2-edc151b1f9c3'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.861250 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b17c8a25c34d4683b3763ee9a9d60d', 'request_id': 'req-692ed947-4afd-46df-bdb2-edc151b1f9c3'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.877439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] The token cache is being invalidate because project 53b17c8a25c34d4683b3763ee9a9d60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:06:06.877841 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.878527 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-692ed947-4afd-46df-bdb2-edc151b1f9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:06.880170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1332/2660] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:06:06 2022] DELETE /identity/v3/projects/53b17c8a25c34d4683b3763ee9a9d60d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:06.888331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c594ac-5007-47a1-be3e-14862a4ef056 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:06.888331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c594ac-5007-47a1-be3e-14862a4ef056 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:06.888331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c594ac-5007-47a1-be3e-14862a4ef056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:06.906782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-63c594ac-5007-47a1-be3e-14862a4ef056 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:06.908001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-63c594ac-5007-47a1-be3e-14862a4ef056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:06.981134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1329/2661] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:06.990322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e7b75-de6b-43d4-8282-1f5b0e13fafc None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:06.990696 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e7b75-de6b-43d4-8282-1f5b0e13fafc None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:06.991051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e7b75-de6b-43d4-8282-1f5b0e13fafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.013548 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9e2e7b75-de6b-43d4-8282-1f5b0e13fafc None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:07.014813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9e2e7b75-de6b-43d4-8282-1f5b0e13fafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:07.024610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1333/2662] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:07.029678 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c594ac-5007-47a1-be3e-14862a4ef056 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.044451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c594ac-5007-47a1-be3e-14862a4ef056 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.050354 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833caae-1991-433f-a2d9-32306edadd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.051011 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833caae-1991-433f-a2d9-32306edadd9f admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.051291 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833caae-1991-433f-a2d9-32306edadd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.051566 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833caae-1991-433f-a2d9-32306edadd9f admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.052317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833caae-1991-433f-a2d9-32306edadd9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:06:07.052622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833caae-1991-433f-a2d9-32306edadd9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.054310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833caae-1991-433f-a2d9-32306edadd9f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.066181 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1330/2663] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:06:07.070657 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e7b75-de6b-43d4-8282-1f5b0e13fafc None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.079974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e7b75-de6b-43d4-8282-1f5b0e13fafc None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.084960 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943b00f-24a0-4247-a087-071dd794b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.085606 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943b00f-24a0-4247-a087-071dd794b3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.085868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943b00f-24a0-4247-a087-071dd794b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.086187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943b00f-24a0-4247-a087-071dd794b3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.086877 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943b00f-24a0-4247-a087-071dd794b3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.088763 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943b00f-24a0-4247-a087-071dd794b3a6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.118800 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1334/2664] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:06:07 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:06:07.123143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833caae-1991-433f-a2d9-32306edadd9f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.133304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833caae-1991-433f-a2d9-32306edadd9f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.197977 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d140f1-8fa6-46b4-9a1f-02eff094f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.198953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d140f1-8fa6-46b4-9a1f-02eff094f19c admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.199335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d140f1-8fa6-46b4-9a1f-02eff094f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.199694 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d140f1-8fa6-46b4-9a1f-02eff094f19c admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.200380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d140f1-8fa6-46b4-9a1f-02eff094f19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.202423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d140f1-8fa6-46b4-9a1f-02eff094f19c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.229472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1331/2665] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:06:07 2022] POST /identity/v3/users => generated 280 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:06:07.233432 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943b00f-24a0-4247-a087-071dd794b3a6 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.245103 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943b00f-24a0-4247-a087-071dd794b3a6 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.250857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba677ded-4a11-4f45-8b5a-190d827a6426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.251566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677ded-4a11-4f45-8b5a-190d827a6426 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.251859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677ded-4a11-4f45-8b5a-190d827a6426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.252107 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677ded-4a11-4f45-8b5a-190d827a6426 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.252866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba677ded-4a11-4f45-8b5a-190d827a6426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.254501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba677ded-4a11-4f45-8b5a-190d827a6426 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.266455 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1335/2666] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:07.270585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d140f1-8fa6-46b4-9a1f-02eff094f19c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.280567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d140f1-8fa6-46b4-9a1f-02eff094f19c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.285708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1cde6-03a6-4d50-ad51-edd2fb7931be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.286405 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1cde6-03a6-4d50-ad51-edd2fb7931be admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.286683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1cde6-03a6-4d50-ad51-edd2fb7931be admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.286954 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1cde6-03a6-4d50-ad51-edd2fb7931be admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.287814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1cde6-03a6-4d50-ad51-edd2fb7931be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.289276 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1cde6-03a6-4d50-ad51-edd2fb7931be admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.304326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1332/2667] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:07.304539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ffcc-5cca-420a-b062-1cc1141abcf0 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.304539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ffcc-5cca-420a-b062-1cc1141abcf0 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.304539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ffcc-5cca-420a-b062-1cc1141abcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.306010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1cde6-03a6-4d50-ad51-edd2fb7931be admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.316189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1cde6-03a6-4d50-ad51-edd2fb7931be admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.321067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-9775ffcc-5cca-420a-b062-1cc1141abcf0 None None] MFA Rules not processed for user `caa282313a4247cca8305b8ce768eb20`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:07.322034 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dea425-1aba-4c4b-bd52-c254feb4a767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.322297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9775ffcc-5cca-420a-b062-1cc1141abcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:07.322923 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dea425-1aba-4c4b-bd52-c254feb4a767 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.323202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dea425-1aba-4c4b-bd52-c254feb4a767 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.323479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dea425-1aba-4c4b-bd52-c254feb4a767 admin admin] PATH_INFO: `/v3/projects/1cc885db44084e28b7cf57517880c737/users/1c782966fd0a47219f2ef8fbb8fcbc3e/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.341780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dea425-1aba-4c4b-bd52-c254feb4a767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc885db44084e28b7cf57517880c737, user_id=1c782966fd0a47219f2ef8fbb8fcbc3e, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.344555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dea425-1aba-4c4b-bd52-c254feb4a767 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.360157 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1333/2668] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:06:07 2022] PUT /identity/v3/projects/1cc885db44084e28b7cf57517880c737/users/1c782966fd0a47219f2ef8fbb8fcbc3e/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:07.370522 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177109-c43a-4481-8405-90c7be240830 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.370711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177109-c43a-4481-8405-90c7be240830 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.371001 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177109-c43a-4481-8405-90c7be240830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.379589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1336/2669] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:07.399548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-ab177109-c43a-4481-8405-90c7be240830 None None] MFA Rules not processed for user `1c782966fd0a47219f2ef8fbb8fcbc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:07.400799 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ab177109-c43a-4481-8405-90c7be240830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:07.469042 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1334/2670] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:07 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:07.500302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ffcc-5cca-420a-b062-1cc1141abcf0 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.501704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9775ffcc-5cca-420a-b062-1cc1141abcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:07.559580 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ffcc-5cca-420a-b062-1cc1141abcf0 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.609041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2e731-d750-4986-af7b-aae04601e65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.609697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2e731-d750-4986-af7b-aae04601e65e service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.610037 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2e731-d750-4986-af7b-aae04601e65e service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.610315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2e731-d750-4986-af7b-aae04601e65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.617992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab177109-c43a-4481-8405-90c7be240830 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.619281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2e731-d750-4986-af7b-aae04601e65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.619398 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ab177109-c43a-4481-8405-90c7be240830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:07.620791 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2e731-d750-4986-af7b-aae04601e65e service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.630412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1337/2671] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:07 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:06:07.644577 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2e731-d750-4986-af7b-aae04601e65e service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.678588 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab177109-c43a-4481-8405-90c7be240830 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.682145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836fd2f-7a35-4a1d-8d3b-82481d2fee83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.682794 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836fd2f-7a35-4a1d-8d3b-82481d2fee83 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.683080 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836fd2f-7a35-4a1d-8d3b-82481d2fee83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.683355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836fd2f-7a35-4a1d-8d3b-82481d2fee83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.685399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0836fd2f-7a35-4a1d-8d3b-82481d2fee83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:07.695122 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836fd2f-7a35-4a1d-8d3b-82481d2fee83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.696588 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836fd2f-7a35-4a1d-8d3b-82481d2fee83 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.705199 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1335/2672] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:06:07.705713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2e731-d750-4986-af7b-aae04601e65e service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.710512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.711392 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.711673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.711945 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] PATH_INFO: `/v3/users/1c782966fd0a47219f2ef8fbb8fcbc3e` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.713143 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c782966fd0a47219f2ef8fbb8fcbc3e)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.715108 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.764599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c782966fd0a47219f2ef8fbb8fcbc3e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:07.766396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c782966fd0a47219f2ef8fbb8fcbc3e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:07.767036 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c782966fd0a47219f2ef8fbb8fcbc3e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:07.776080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c782966fd0a47219f2ef8fbb8fcbc3e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:07.783534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c782966fd0a47219f2ef8fbb8fcbc3e'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:07.807089 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1338/2673] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:06:07 2022] DELETE /identity/v3/users/1c782966fd0a47219f2ef8fbb8fcbc3e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:06:07.811732 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9edb-8a4d-481f-8b20-ce5ae99150a7 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.812022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9edb-8a4d-481f-8b20-ce5ae99150a7 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.812299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9edb-8a4d-481f-8b20-ce5ae99150a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.834490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-846f9edb-8a4d-481f-8b20-ce5ae99150a7 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:07.835856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-846f9edb-8a4d-481f-8b20-ce5ae99150a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:07.896327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1336/2674] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:07.906326 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:07.907858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:07.965388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bcc7c-7a2f-427b-a90c-e719ca19bc54 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:07.969560 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318b2bc-74de-4f06-a675-32655b42d0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:07.970252 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b2bc-74de-4f06-a675-32655b42d0fe service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:07.970532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b2bc-74de-4f06-a675-32655b42d0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:07.970805 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b2bc-74de-4f06-a675-32655b42d0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:07.982115 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318b2bc-74de-4f06-a675-32655b42d0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:07.983807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318b2bc-74de-4f06-a675-32655b42d0fe service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:07.994204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1339/2675] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:06:08.306238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f9edb-8a4d-481f-8b20-ce5ae99150a7 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:08.307732 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-846f9edb-8a4d-481f-8b20-ce5ae99150a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:08.326833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f9edb-8a4d-481f-8b20-ce5ae99150a7 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:08.333973 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:08.334880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.335277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.335585 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] PATH_INFO: `/v3/projects/1cc885db44084e28b7cf57517880c737` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.336969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc885db44084e28b7cf57517880c737)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:08.338962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:08.396120 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc885db44084e28b7cf57517880c737', 'request_id': 'req-5aaaa9df-107c-436f-933d-6893a2e1a0a7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:08.401589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc885db44084e28b7cf57517880c737', 'request_id': 'req-5aaaa9df-107c-436f-933d-6893a2e1a0a7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:08.409902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc885db44084e28b7cf57517880c737', 'request_id': 'req-5aaaa9df-107c-436f-933d-6893a2e1a0a7'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:08.422992 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] The token cache is being invalidate because project 1cc885db44084e28b7cf57517880c737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:06:08.423472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:08.424421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-5aaaa9df-107c-436f-933d-6893a2e1a0a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:08.426605 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1337/2676] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:06:08 2022] DELETE /identity/v3/projects/1cc885db44084e28b7cf57517880c737 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:08.433534 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f442f01-a546-4a78-a96c-c6d635617fc5 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.433833 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f442f01-a546-4a78-a96c-c6d635617fc5 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.434171 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f442f01-a546-4a78-a96c-c6d635617fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.452493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1f442f01-a546-4a78-a96c-c6d635617fc5 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:08.453710 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1f442f01-a546-4a78-a96c-c6d635617fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:08.516136 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1340/2677] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:08.525000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da508814-203e-46ef-8a60-d1368c16a47a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.525456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da508814-203e-46ef-8a60-d1368c16a47a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.525684 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da508814-203e-46ef-8a60-d1368c16a47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.547650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-da508814-203e-46ef-8a60-d1368c16a47a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:08.549972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-da508814-203e-46ef-8a60-d1368c16a47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:08.559428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1338/2678] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:08.563435 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f442f01-a546-4a78-a96c-c6d635617fc5 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:08.573265 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f442f01-a546-4a78-a96c-c6d635617fc5 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:08.578427 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea8df-9f28-48c2-afc9-31f8b5ce5c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:08.579079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea8df-9f28-48c2-afc9-31f8b5ce5c57 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.579359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea8df-9f28-48c2-afc9-31f8b5ce5c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.579666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea8df-9f28-48c2-afc9-31f8b5ce5c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.580450 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea8df-9f28-48c2-afc9-31f8b5ce5c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:06:08.580793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea8df-9f28-48c2-afc9-31f8b5ce5c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:08.582570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea8df-9f28-48c2-afc9-31f8b5ce5c57 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:08.597856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1341/2679] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:06:08.602324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da508814-203e-46ef-8a60-d1368c16a47a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:08.611811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da508814-203e-46ef-8a60-d1368c16a47a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:08.617115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768c81-b2c9-49b3-8b5a-a475d6734268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:08.617783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768c81-b2c9-49b3-8b5a-a475d6734268 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.618123 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768c81-b2c9-49b3-8b5a-a475d6734268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.618411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768c81-b2c9-49b3-8b5a-a475d6734268 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.619102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f768c81-b2c9-49b3-8b5a-a475d6734268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:08.621065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f768c81-b2c9-49b3-8b5a-a475d6734268 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:08.655639 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1339/2680] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:06:08 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:06:08.659968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea8df-9f28-48c2-afc9-31f8b5ce5c57 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:08.670845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea8df-9f28-48c2-afc9-31f8b5ce5c57 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:08.733308 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c34ecb-a23f-46c4-9d0d-cb7969653021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:08.734002 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34ecb-a23f-46c4-9d0d-cb7969653021 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.734293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34ecb-a23f-46c4-9d0d-cb7969653021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.734585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34ecb-a23f-46c4-9d0d-cb7969653021 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.735373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c34ecb-a23f-46c4-9d0d-cb7969653021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:08.737393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c34ecb-a23f-46c4-9d0d-cb7969653021 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:08.758635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1342/2681] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:06:08 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:06:08.762897 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768c81-b2c9-49b3-8b5a-a475d6734268 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:08.777448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768c81-b2c9-49b3-8b5a-a475d6734268 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:08.782873 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54423ed2-1fe9-41ce-90c4-9d1900dc3709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:08.783533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423ed2-1fe9-41ce-90c4-9d1900dc3709 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.783813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423ed2-1fe9-41ce-90c4-9d1900dc3709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.784092 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423ed2-1fe9-41ce-90c4-9d1900dc3709 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.784811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54423ed2-1fe9-41ce-90c4-9d1900dc3709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:08.786472 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54423ed2-1fe9-41ce-90c4-9d1900dc3709 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:08.797170 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1340/2682] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:06:08.801909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c34ecb-a23f-46c4-9d0d-cb7969653021 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:08.815080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c34ecb-a23f-46c4-9d0d-cb7969653021 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:08.820871 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced97e4-daa5-479b-bf10-0487f19b0659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:08.821539 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced97e4-daa5-479b-bf10-0487f19b0659 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.821819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced97e4-daa5-479b-bf10-0487f19b0659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.822132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced97e4-daa5-479b-bf10-0487f19b0659 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.822866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced97e4-daa5-479b-bf10-0487f19b0659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:08.825126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced97e4-daa5-479b-bf10-0487f19b0659 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:08.836330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1343/2683] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:08.840459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54423ed2-1fe9-41ce-90c4-9d1900dc3709 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:08.852562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54423ed2-1fe9-41ce-90c4-9d1900dc3709 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:08.857645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080381e1-a165-4f60-ac9e-e22e608c6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:08.858466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080381e1-a165-4f60-ac9e-e22e608c6cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.858747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080381e1-a165-4f60-ac9e-e22e608c6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.859026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080381e1-a165-4f60-ac9e-e22e608c6cf9 admin admin] PATH_INFO: `/v3/projects/ada44c5a145c4f9dae5ca0c3999dc3d8/users/6b777fd0120e46bb9528f7ac004d2579/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.876476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080381e1-a165-4f60-ac9e-e22e608c6cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada44c5a145c4f9dae5ca0c3999dc3d8, user_id=6b777fd0120e46bb9528f7ac004d2579, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:08.879933 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080381e1-a165-4f60-ac9e-e22e608c6cf9 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:08.896479 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1341/2684] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:06:08 2022] PUT /identity/v3/projects/ada44c5a145c4f9dae5ca0c3999dc3d8/users/6b777fd0120e46bb9528f7ac004d2579/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:06:08.906814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad21c08-0448-4d7f-a1e9-013646d6b846 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:08.907077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad21c08-0448-4d7f-a1e9-013646d6b846 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:08.907359 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad21c08-0448-4d7f-a1e9-013646d6b846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:08.938519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-fad21c08-0448-4d7f-a1e9-013646d6b846 None None] MFA Rules not processed for user `6b777fd0120e46bb9528f7ac004d2579`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:08.939704 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-fad21c08-0448-4d7f-a1e9-013646d6b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:09.023276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1344/2685] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:09.036023 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080381e1-a165-4f60-ac9e-e22e608c6cf9 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:09.038817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-080381e1-a165-4f60-ac9e-e22e608c6cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:09.105557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080381e1-a165-4f60-ac9e-e22e608c6cf9 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:09.109772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cc91e-92bf-4920-964c-cf2ef84a5197 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:09.110481 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cc91e-92bf-4920-964c-cf2ef84a5197 service glance] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:09.110765 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cc91e-92bf-4920-964c-cf2ef84a5197 service glance] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:09.111045 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cc91e-92bf-4920-964c-cf2ef84a5197 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:09.126319 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cc91e-92bf-4920-964c-cf2ef84a5197 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:09.128430 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cc91e-92bf-4920-964c-cf2ef84a5197 service glance] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:09.143764 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1342/2686] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:06:23.095984 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831bbb0-e40b-4baa-81f5-ff178ad10ab3 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:23.096507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831bbb0-e40b-4baa-81f5-ff178ad10ab3 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:23.096507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831bbb0-e40b-4baa-81f5-ff178ad10ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:23.116318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-7831bbb0-e40b-4baa-81f5-ff178ad10ab3 None None] MFA Rules not processed for user `caa282313a4247cca8305b8ce768eb20`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:23.117535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7831bbb0-e40b-4baa-81f5-ff178ad10ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:23.186677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1345/2687] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:44.315750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cc91e-92bf-4920-964c-cf2ef84a5197 service glance] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:44.384534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cc91e-92bf-4920-964c-cf2ef84a5197 service glance] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:44.389577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:44.390496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:44.390773 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:44.391049 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] PATH_INFO: `/v3/users/6b777fd0120e46bb9528f7ac004d2579` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:44.392273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b777fd0120e46bb9528f7ac004d2579)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:44.394246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:44.442902 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b777fd0120e46bb9528f7ac004d2579'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:44.457272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b777fd0120e46bb9528f7ac004d2579'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:44.469958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b777fd0120e46bb9528f7ac004d2579'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:44.470658 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b777fd0120e46bb9528f7ac004d2579'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:44.478080 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b777fd0120e46bb9528f7ac004d2579'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:44.484320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1343/2688] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:06:44 2022] DELETE /identity/v3/users/6b777fd0120e46bb9528f7ac004d2579 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:06:44.489003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6314e6-f55b-4b7a-ac35-ef0bbe0242e6 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:44.489602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6314e6-f55b-4b7a-ac35-ef0bbe0242e6 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:44.489602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6314e6-f55b-4b7a-ac35-ef0bbe0242e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:44.507883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-ab6314e6-f55b-4b7a-ac35-ef0bbe0242e6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:44.509097 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ab6314e6-f55b-4b7a-ac35-ef0bbe0242e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:44.575636 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1346/2689] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:44.585664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:44.587359 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:44.659201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6867c84-de8d-4878-84df-066923b69a96 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:44.663428 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd94a7-ded4-4776-abd4-da5801d3e56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:44.664056 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd94a7-ded4-4776-abd4-da5801d3e56c service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:44.664388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd94a7-ded4-4776-abd4-da5801d3e56c service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:44.664649 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd94a7-ded4-4776-abd4-da5801d3e56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:44.674988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd94a7-ded4-4776-abd4-da5801d3e56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:44.676447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd94a7-ded4-4776-abd4-da5801d3e56c service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:44.686824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1344/2690] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:06:44.972042 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6314e6-f55b-4b7a-ac35-ef0bbe0242e6 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:44.973490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ab6314e6-f55b-4b7a-ac35-ef0bbe0242e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:44.986985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6314e6-f55b-4b7a-ac35-ef0bbe0242e6 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:44.992552 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:44.993735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:44.994048 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:44.994327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] PATH_INFO: `/v3/projects/ada44c5a145c4f9dae5ca0c3999dc3d8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:44.995612 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada44c5a145c4f9dae5ca0c3999dc3d8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:44.998839 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:45.053584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada44c5a145c4f9dae5ca0c3999dc3d8', 'request_id': 'req-79e6559c-0163-4d8c-8817-c57b026ac8a6'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:45.060004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada44c5a145c4f9dae5ca0c3999dc3d8', 'request_id': 'req-79e6559c-0163-4d8c-8817-c57b026ac8a6'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:45.066908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada44c5a145c4f9dae5ca0c3999dc3d8', 'request_id': 'req-79e6559c-0163-4d8c-8817-c57b026ac8a6'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:45.080831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] The token cache is being invalidate because project ada44c5a145c4f9dae5ca0c3999dc3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:06:45.081128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:45.083044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-79e6559c-0163-4d8c-8817-c57b026ac8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:06:45.084526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1347/2691] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:06:44 2022] DELETE /identity/v3/projects/ada44c5a145c4f9dae5ca0c3999dc3d8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:06:45.089608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20616602-12ad-46d7-aa86-e076e4925ea4 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.089818 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20616602-12ad-46d7-aa86-e076e4925ea4 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.090115 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20616602-12ad-46d7-aa86-e076e4925ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.108720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-20616602-12ad-46d7-aa86-e076e4925ea4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:45.109911 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-20616602-12ad-46d7-aa86-e076e4925ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:45.171437 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1345/2692] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:06:45.183184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921c25-245b-4128-9912-8d5826b6b42d None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.183473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921c25-245b-4128-9912-8d5826b6b42d None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.183722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21921c25-245b-4128-9912-8d5826b6b42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.205332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-21921c25-245b-4128-9912-8d5826b6b42d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:45.206578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-21921c25-245b-4128-9912-8d5826b6b42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:45.216843 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1348/2693] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:45.222053 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20616602-12ad-46d7-aa86-e076e4925ea4 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:45.235177 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20616602-12ad-46d7-aa86-e076e4925ea4 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:45.240988 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e799c-9f26-454e-abbd-6a40d2569408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:45.241664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e799c-9f26-454e-abbd-6a40d2569408 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.241969 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e799c-9f26-454e-abbd-6a40d2569408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.242272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e799c-9f26-454e-abbd-6a40d2569408 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.242997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e799c-9f26-454e-abbd-6a40d2569408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:06:45.243370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e799c-9f26-454e-abbd-6a40d2569408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:45.245005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e799c-9f26-454e-abbd-6a40d2569408 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:45.258604 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1346/2694] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:06:45.263379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921c25-245b-4128-9912-8d5826b6b42d None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:45.274850 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21921c25-245b-4128-9912-8d5826b6b42d None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:45.283312 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49563-4509-4b12-836b-f89f01b985ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:45.284245 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49563-4509-4b12-836b-f89f01b985ee admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.284653 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49563-4509-4b12-836b-f89f01b985ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.285003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49563-4509-4b12-836b-f89f01b985ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.285949 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a49563-4509-4b12-836b-f89f01b985ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:45.288749 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a49563-4509-4b12-836b-f89f01b985ee admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:45.320667 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1349/2695] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:06:45 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:06:45.325290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e799c-9f26-454e-abbd-6a40d2569408 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:45.335174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e799c-9f26-454e-abbd-6a40d2569408 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:45.403333 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8568b-5827-451c-9107-ef4525b7b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:45.404016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8568b-5827-451c-9107-ef4525b7b11a admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.404295 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8568b-5827-451c-9107-ef4525b7b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.404565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8568b-5827-451c-9107-ef4525b7b11a admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.405254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8568b-5827-451c-9107-ef4525b7b11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:45.407217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8568b-5827-451c-9107-ef4525b7b11a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:45.428731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1347/2696] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:06:45 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:06:45.434441 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49563-4509-4b12-836b-f89f01b985ee admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:45.445027 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49563-4509-4b12-836b-f89f01b985ee admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:45.450130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9b618-5557-4a03-b08e-959914c2f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:45.450804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9b618-5557-4a03-b08e-959914c2f8cd admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.451067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9b618-5557-4a03-b08e-959914c2f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.451339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9b618-5557-4a03-b08e-959914c2f8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.452075 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9b618-5557-4a03-b08e-959914c2f8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:45.453698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9b618-5557-4a03-b08e-959914c2f8cd admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:45.464951 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1350/2697] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:45.471508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8568b-5827-451c-9107-ef4525b7b11a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:45.487953 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8568b-5827-451c-9107-ef4525b7b11a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:45.496751 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823d018-bb27-46d1-95c0-7c50bb319444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:45.497429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823d018-bb27-46d1-95c0-7c50bb319444 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.497716 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823d018-bb27-46d1-95c0-7c50bb319444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.498022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823d018-bb27-46d1-95c0-7c50bb319444 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.498761 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823d018-bb27-46d1-95c0-7c50bb319444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:45.500385 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823d018-bb27-46d1-95c0-7c50bb319444 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:45.511346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1348/2698] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:06:45.516167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9b618-5557-4a03-b08e-959914c2f8cd admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:45.529366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9b618-5557-4a03-b08e-959914c2f8cd admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:45.535162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876d836-9dfc-4644-a83a-1143a8873880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:45.536053 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d836-9dfc-4644-a83a-1143a8873880 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.536329 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d836-9dfc-4644-a83a-1143a8873880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.536604 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d836-9dfc-4644-a83a-1143a8873880 admin admin] PATH_INFO: `/v3/projects/c699b2512029498981a9e7d2592a306b/users/4988912db9e8432cb87723dd81f18f3b/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.553010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876d836-9dfc-4644-a83a-1143a8873880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c699b2512029498981a9e7d2592a306b, user_id=4988912db9e8432cb87723dd81f18f3b, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:45.557332 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876d836-9dfc-4644-a83a-1143a8873880 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:45.576798 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1351/2699] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:06:45 2022] PUT /identity/v3/projects/c699b2512029498981a9e7d2592a306b/users/4988912db9e8432cb87723dd81f18f3b/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:06:45.592778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73479fe-369f-448f-a978-a83b385e59fb None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.593108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73479fe-369f-448f-a978-a83b385e59fb None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.593390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73479fe-369f-448f-a978-a83b385e59fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.620564 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c73479fe-369f-448f-a978-a83b385e59fb None None] MFA Rules not processed for user `4988912db9e8432cb87723dd81f18f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:45.621821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c73479fe-369f-448f-a978-a83b385e59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:45.688600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1349/2700] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:45.700324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876d836-9dfc-4644-a83a-1143a8873880 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:45.702375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3876d836-9dfc-4644-a83a-1143a8873880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:45.789968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876d836-9dfc-4644-a83a-1143a8873880 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:45.795026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecd017-3678-493d-bcd4-d9468ffc57b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:45.795684 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecd017-3678-493d-bcd4-d9468ffc57b5 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:45.795966 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecd017-3678-493d-bcd4-d9468ffc57b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:45.796240 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecd017-3678-493d-bcd4-d9468ffc57b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:45.805848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecd017-3678-493d-bcd4-d9468ffc57b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:45.807322 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecd017-3678-493d-bcd4-d9468ffc57b5 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:45.818263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1352/2701] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:06:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:06:48.365000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78499a9-310e-4c7d-b92a-76f56444c975 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:48.365637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78499a9-310e-4c7d-b92a-76f56444c975 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:48.365637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78499a9-310e-4c7d-b92a-76f56444c975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:48.399264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a78499a9-310e-4c7d-b92a-76f56444c975 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:06:48.400467 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a78499a9-310e-4c7d-b92a-76f56444c975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:48.456904 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1350/2702] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 20:06:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:06:48.513162 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecd017-3678-493d-bcd4-d9468ffc57b5 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:06:48.514610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-24ecd017-3678-493d-bcd4-d9468ffc57b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:06:48.586244 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecd017-3678-493d-bcd4-d9468ffc57b5 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:06:48.591762 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a20a0-c8d4-4049-87d1-1811f2ce7e16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:06:48.592415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a20a0-c8d4-4049-87d1-1811f2ce7e16 service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:06:48.592698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a20a0-c8d4-4049-87d1-1811f2ce7e16 service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:06:48.592999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a20a0-c8d4-4049-87d1-1811f2ce7e16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:06:48.603078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a20a0-c8d4-4049-87d1-1811f2ce7e16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:06:48.604831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a20a0-c8d4-4049-87d1-1811f2ce7e16 service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:06:48.613814 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1353/2703] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:06:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:07:03.996216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66f383-2a2c-486c-9446-514eca17ae8e None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:03.996782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66f383-2a2c-486c-9446-514eca17ae8e None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:03.996782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66f383-2a2c-486c-9446-514eca17ae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:04.025683 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-0e66f383-2a2c-486c-9446-514eca17ae8e None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:04.027031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0e66f383-2a2c-486c-9446-514eca17ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:04.040186 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1351/2704] 10.222.0.49 () {58 vars in 967 bytes} [Tue Mar 22 20:07:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:04.053391 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a20a0-c8d4-4049-87d1-1811f2ce7e16 service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:04.064634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a20a0-c8d4-4049-87d1-1811f2ce7e16 service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:04.071111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eb9fb-9343-4ee0-9970-bd250151efce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:04.071771 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eb9fb-9343-4ee0-9970-bd250151efce service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:04.072051 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eb9fb-9343-4ee0-9970-bd250151efce service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:04.072324 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eb9fb-9343-4ee0-9970-bd250151efce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:04.082059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eb9fb-9343-4ee0-9970-bd250151efce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:04.083708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eb9fb-9343-4ee0-9970-bd250151efce service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:04.106197 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1354/2705] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:07:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:07:06.128741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66f383-2a2c-486c-9446-514eca17ae8e None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:06.130297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0e66f383-2a2c-486c-9446-514eca17ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:06.209955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66f383-2a2c-486c-9446-514eca17ae8e None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:06.215754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:06.217057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:06.217335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:06.217605 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] PATH_INFO: `/v3/users/caa282313a4247cca8305b8ce768eb20` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:06.218914 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa282313a4247cca8305b8ce768eb20)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:06.220819 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:06.274692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa282313a4247cca8305b8ce768eb20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.288497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa282313a4247cca8305b8ce768eb20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.296734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa282313a4247cca8305b8ce768eb20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.297459 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa282313a4247cca8305b8ce768eb20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.305000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-78faff5d-e6dd-45e3-80b8-22eff20b19df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa282313a4247cca8305b8ce768eb20'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.311224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1352/2706] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:06 2022] DELETE /identity/v3/users/caa282313a4247cca8305b8ce768eb20 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:06.494987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eb9fb-9343-4ee0-9970-bd250151efce service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:06.509152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eb9fb-9343-4ee0-9970-bd250151efce service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:06.576675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:06.577559 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:06.577842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:06.578153 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] PATH_INFO: `/v3/projects/5d4fac71b40b449488b751ae1759a917` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:06.579480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4fac71b40b449488b751ae1759a917)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:06.581410 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:06.631824 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4fac71b40b449488b751ae1759a917', 'request_id': 'req-01c3ec47-cf54-4ff6-896e-bf1386ae6739'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.639607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4fac71b40b449488b751ae1759a917', 'request_id': 'req-01c3ec47-cf54-4ff6-896e-bf1386ae6739'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.646794 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4fac71b40b449488b751ae1759a917', 'request_id': 'req-01c3ec47-cf54-4ff6-896e-bf1386ae6739'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.661321 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] The token cache is being invalidate because project 5d4fac71b40b449488b751ae1759a917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:06.662073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.662384 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-01c3ec47-cf54-4ff6-896e-bf1386ae6739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:06.665991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1355/2707] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:06 2022] DELETE /identity/v3/projects/5d4fac71b40b449488b751ae1759a917 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:06.671544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc207f-d96b-4665-9000-48839d8c84a3 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:06.671839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc207f-d96b-4665-9000-48839d8c84a3 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:06.672124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc207f-d96b-4665-9000-48839d8c84a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:06.692297 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-28cc207f-d96b-4665-9000-48839d8c84a3 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:06.693959 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-28cc207f-d96b-4665-9000-48839d8c84a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:06.761373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1353/2708] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:07:06.769614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a7627-76cf-4501-9bc9-1743a3459673 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:06.769964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a7627-76cf-4501-9bc9-1743a3459673 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:06.770272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a7627-76cf-4501-9bc9-1743a3459673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:06.795057 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1d4a7627-76cf-4501-9bc9-1743a3459673 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:06.796295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1d4a7627-76cf-4501-9bc9-1743a3459673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:06.810189 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1356/2709] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:06.810820 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc207f-d96b-4665-9000-48839d8c84a3 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:06.821277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc207f-d96b-4665-9000-48839d8c84a3 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:06.827364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9fe18-7412-42d7-b681-23e18abef714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:06.828156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9fe18-7412-42d7-b681-23e18abef714 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:06.828444 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9fe18-7412-42d7-b681-23e18abef714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:06.828718 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9fe18-7412-42d7-b681-23e18abef714 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:06.829454 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9fe18-7412-42d7-b681-23e18abef714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:07:06.829758 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9fe18-7412-42d7-b681-23e18abef714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:06.831715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9fe18-7412-42d7-b681-23e18abef714 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:06.848272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1354/2710] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:07:06.849463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a7627-76cf-4501-9bc9-1743a3459673 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:06.859716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a7627-76cf-4501-9bc9-1743a3459673 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:06.865017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e0603-9ef4-4b91-a1eb-dd4ec6c2e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:06.866331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0603-9ef4-4b91-a1eb-dd4ec6c2e57e admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:06.866331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0603-9ef4-4b91-a1eb-dd4ec6c2e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:06.866331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0603-9ef4-4b91-a1eb-dd4ec6c2e57e admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:06.866969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e0603-9ef4-4b91-a1eb-dd4ec6c2e57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:06.868914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e0603-9ef4-4b91-a1eb-dd4ec6c2e57e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:06.899700 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1357/2711] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:07:06 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:07:06.905769 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9fe18-7412-42d7-b681-23e18abef714 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:06.916877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9fe18-7412-42d7-b681-23e18abef714 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:06.983164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ea337-d2e9-4bd9-a77d-85258343574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:06.983857 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea337-d2e9-4bd9-a77d-85258343574b admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:06.984103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea337-d2e9-4bd9-a77d-85258343574b admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:06.984393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea337-d2e9-4bd9-a77d-85258343574b admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:06.985087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ea337-d2e9-4bd9-a77d-85258343574b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:06.987043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ea337-d2e9-4bd9-a77d-85258343574b admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:07.011410 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1355/2712] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:07:06 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:07:07.016297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e0603-9ef4-4b91-a1eb-dd4ec6c2e57e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:07.030409 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e0603-9ef4-4b91-a1eb-dd4ec6c2e57e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:07.037203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9574f-5377-46bc-9028-1d3a5b8db4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:07.037912 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9574f-5377-46bc-9028-1d3a5b8db4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:07.038227 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9574f-5377-46bc-9028-1d3a5b8db4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:07.038499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9574f-5377-46bc-9028-1d3a5b8db4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:07.039229 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9574f-5377-46bc-9028-1d3a5b8db4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:07.040849 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9574f-5377-46bc-9028-1d3a5b8db4a4 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:07.053643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1358/2713] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:07.058236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ea337-d2e9-4bd9-a77d-85258343574b admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:07.074363 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ea337-d2e9-4bd9-a77d-85258343574b admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:07.081635 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d9ce1-0821-432a-a8c5-4099a676da18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:07.082337 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d9ce1-0821-432a-a8c5-4099a676da18 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:07.082616 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d9ce1-0821-432a-a8c5-4099a676da18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:07.082896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d9ce1-0821-432a-a8c5-4099a676da18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:07.083614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d9ce1-0821-432a-a8c5-4099a676da18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:07.085210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d9ce1-0821-432a-a8c5-4099a676da18 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:07.098304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1356/2714] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:07.103884 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9574f-5377-46bc-9028-1d3a5b8db4a4 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:07.121294 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9574f-5377-46bc-9028-1d3a5b8db4a4 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:07.126578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251577db-7a7a-472c-8343-9e2bf7137957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:07.127475 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251577db-7a7a-472c-8343-9e2bf7137957 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:07.127755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251577db-7a7a-472c-8343-9e2bf7137957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:07.128040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251577db-7a7a-472c-8343-9e2bf7137957 admin admin] PATH_INFO: `/v3/projects/4e9c8f8970a945989180ebec23a58dc3/users/73023820d5ca4965b95a05611a7cc62b/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:07.144777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251577db-7a7a-472c-8343-9e2bf7137957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9c8f8970a945989180ebec23a58dc3, user_id=73023820d5ca4965b95a05611a7cc62b, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:07.147557 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251577db-7a7a-472c-8343-9e2bf7137957 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:07.172096 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1359/2715] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:07 2022] PUT /identity/v3/projects/4e9c8f8970a945989180ebec23a58dc3/users/73023820d5ca4965b95a05611a7cc62b/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:07.173701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ef31-2ce7-40f8-bc58-2dd561a45985 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:07.174216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ef31-2ce7-40f8-bc58-2dd561a45985 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:07.174392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ef31-2ce7-40f8-bc58-2dd561a45985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:07.202421 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-d7c4ef31-2ce7-40f8-bc58-2dd561a45985 None None] MFA Rules not processed for user `73023820d5ca4965b95a05611a7cc62b`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:07.203650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d7c4ef31-2ce7-40f8-bc58-2dd561a45985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:07.217955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251577db-7a7a-472c-8343-9e2bf7137957 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:07.219792 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-251577db-7a7a-472c-8343-9e2bf7137957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:07.279723 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1357/2716] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:07.281459 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251577db-7a7a-472c-8343-9e2bf7137957 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:07.285819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:07.286498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:07.286780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:07.287054 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:07.289075 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:07.291296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ef31-2ce7-40f8-bc58-2dd561a45985 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:07.292634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-d7c4ef31-2ce7-40f8-bc58-2dd561a45985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:07.351731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ef31-2ce7-40f8-bc58-2dd561a45985 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:07.354417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:07.356891 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a65ec4-768c-48c1-b232-631f0a8ff930 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:07.357060 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:07.357651 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a65ec4-768c-48c1-b232-631f0a8ff930 service glance] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:07.357964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a65ec4-768c-48c1-b232-631f0a8ff930 service glance] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:07.358451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a65ec4-768c-48c1-b232-631f0a8ff930 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:07.371394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a65ec4-768c-48c1-b232-631f0a8ff930 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:07.371971 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1360/2717] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:07:07.372853 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a65ec4-768c-48c1-b232-631f0a8ff930 service glance] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:07.383880 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1358/2718] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:07:10.717491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:10.720986 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:10.743447 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff0d1-a528-48d1-b0d8-b2ac36f171bb service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:10.754954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:10.756789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:10.757546 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:10.758238 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] PATH_INFO: `/v3/users/dc6e41197447403b9d424c1637d231aa` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:10.776146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6e41197447403b9d424c1637d231aa)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:10.778590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:10.844120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6e41197447403b9d424c1637d231aa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:10.844812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6e41197447403b9d424c1637d231aa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:10.845474 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6e41197447403b9d424c1637d231aa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:10.856304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6e41197447403b9d424c1637d231aa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:10.864549 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-29a36b78-c4b9-41ec-a76c-96d4dd1a7ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6e41197447403b9d424c1637d231aa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:10.884605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1361/2719] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:10 2022] DELETE /identity/v3/users/dc6e41197447403b9d424c1637d231aa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:11.093336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a65ec4-768c-48c1-b232-631f0a8ff930 service glance] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:11.123774 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a65ec4-768c-48c1-b232-631f0a8ff930 service glance] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:11.182574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:11.183578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.183912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.184188 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] PATH_INFO: `/v3/projects/5d18e0a0c78841f2aed89c8298906171` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.196530 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d18e0a0c78841f2aed89c8298906171)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:11.198442 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:11.249783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d18e0a0c78841f2aed89c8298906171', 'request_id': 'req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:11.255221 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d18e0a0c78841f2aed89c8298906171', 'request_id': 'req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:11.266576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d18e0a0c78841f2aed89c8298906171', 'request_id': 'req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:11.279420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] The token cache is being invalidate because project 5d18e0a0c78841f2aed89c8298906171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:11.279693 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:11.280357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-b8f5ddd9-d066-457b-ab1a-b6cc49bf1fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:11.281987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1359/2720] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:11 2022] DELETE /identity/v3/projects/5d18e0a0c78841f2aed89c8298906171 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:11.287056 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893463ac-46a1-42e9-8bae-d1a92d876760 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.287337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893463ac-46a1-42e9-8bae-d1a92d876760 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.287611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893463ac-46a1-42e9-8bae-d1a92d876760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.305976 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-893463ac-46a1-42e9-8bae-d1a92d876760 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:11.307185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-893463ac-46a1-42e9-8bae-d1a92d876760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:11.367722 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1362/2721] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:11.376822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd11d3-cef5-4834-b54e-fcdab2ae75c6 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.377127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd11d3-cef5-4834-b54e-fcdab2ae75c6 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.377403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd11d3-cef5-4834-b54e-fcdab2ae75c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.397559 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-1abd11d3-cef5-4834-b54e-fcdab2ae75c6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:11.398922 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-1abd11d3-cef5-4834-b54e-fcdab2ae75c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:11.409026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1360/2722] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:11.413607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893463ac-46a1-42e9-8bae-d1a92d876760 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:11.423881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893463ac-46a1-42e9-8bae-d1a92d876760 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:11.429083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0918dd-cdb3-4c72-86d1-83fd3b9d9714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:11.429746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0918dd-cdb3-4c72-86d1-83fd3b9d9714 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.430078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0918dd-cdb3-4c72-86d1-83fd3b9d9714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.430345 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0918dd-cdb3-4c72-86d1-83fd3b9d9714 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.431080 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0918dd-cdb3-4c72-86d1-83fd3b9d9714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:07:11.431390 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0918dd-cdb3-4c72-86d1-83fd3b9d9714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:11.433043 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0918dd-cdb3-4c72-86d1-83fd3b9d9714 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:11.445429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1363/2723] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:07:11.450313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd11d3-cef5-4834-b54e-fcdab2ae75c6 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:11.459491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd11d3-cef5-4834-b54e-fcdab2ae75c6 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:11.464662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c5b55-b643-4fcd-9131-a5e3bbe9aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:11.465400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c5b55-b643-4fcd-9131-a5e3bbe9aa8c admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.465685 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c5b55-b643-4fcd-9131-a5e3bbe9aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.465984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c5b55-b643-4fcd-9131-a5e3bbe9aa8c admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.467027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c5b55-b643-4fcd-9131-a5e3bbe9aa8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:11.469057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c5b55-b643-4fcd-9131-a5e3bbe9aa8c admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:11.499996 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1361/2724] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:07:11 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:11.504428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0918dd-cdb3-4c72-86d1-83fd3b9d9714 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:11.515535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0918dd-cdb3-4c72-86d1-83fd3b9d9714 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:11.575358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea655948-de70-4d70-aef9-40c7360e2028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:11.576050 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea655948-de70-4d70-aef9-40c7360e2028 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.576336 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea655948-de70-4d70-aef9-40c7360e2028 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.576614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea655948-de70-4d70-aef9-40c7360e2028 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.577317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea655948-de70-4d70-aef9-40c7360e2028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:11.579301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea655948-de70-4d70-aef9-40c7360e2028 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:11.603237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1364/2725] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:07:11 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:11.608918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c5b55-b643-4fcd-9131-a5e3bbe9aa8c admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:11.623835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c5b55-b643-4fcd-9131-a5e3bbe9aa8c admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:11.629053 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab163c2-a5f7-4828-af26-c9cfe7507ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:11.629778 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab163c2-a5f7-4828-af26-c9cfe7507ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.630085 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab163c2-a5f7-4828-af26-c9cfe7507ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.630357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab163c2-a5f7-4828-af26-c9cfe7507ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.631087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab163c2-a5f7-4828-af26-c9cfe7507ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:11.632710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab163c2-a5f7-4828-af26-c9cfe7507ac2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:11.645056 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1362/2726] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:11.649412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea655948-de70-4d70-aef9-40c7360e2028 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:11.661388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea655948-de70-4d70-aef9-40c7360e2028 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:11.667160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf52ce3-3c41-4730-9c15-0e48f23d80a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:11.667867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf52ce3-3c41-4730-9c15-0e48f23d80a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.668148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf52ce3-3c41-4730-9c15-0e48f23d80a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.668466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf52ce3-3c41-4730-9c15-0e48f23d80a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.669210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf52ce3-3c41-4730-9c15-0e48f23d80a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:11.671027 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf52ce3-3c41-4730-9c15-0e48f23d80a9 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:11.681614 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1365/2727] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:11.686393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab163c2-a5f7-4828-af26-c9cfe7507ac2 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:11.696640 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab163c2-a5f7-4828-af26-c9cfe7507ac2 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:11.702675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e41cc0-9617-4f76-aa1c-7bd370ea42c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:11.703483 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41cc0-9617-4f76-aa1c-7bd370ea42c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.703760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41cc0-9617-4f76-aa1c-7bd370ea42c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.704028 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41cc0-9617-4f76-aa1c-7bd370ea42c2 admin admin] PATH_INFO: `/v3/projects/c775e11dbfb2466c84fc9b4b6319935c/users/61f38e7343764429a587313694856204/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.719926 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e41cc0-9617-4f76-aa1c-7bd370ea42c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c775e11dbfb2466c84fc9b4b6319935c, user_id=61f38e7343764429a587313694856204, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:11.722653 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e41cc0-9617-4f76-aa1c-7bd370ea42c2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:11.737835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1363/2728] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:11 2022] PUT /identity/v3/projects/c775e11dbfb2466c84fc9b4b6319935c/users/61f38e7343764429a587313694856204/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:11.743797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817c286-2ac7-48d6-ad67-9ea6d2616851 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.744280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817c286-2ac7-48d6-ad67-9ea6d2616851 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.744395 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817c286-2ac7-48d6-ad67-9ea6d2616851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.770085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-2817c286-2ac7-48d6-ad67-9ea6d2616851 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:11.771375 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2817c286-2ac7-48d6-ad67-9ea6d2616851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:11.838670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1366/2729] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:11.849979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e41cc0-9617-4f76-aa1c-7bd370ea42c2 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:11.851872 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-27e41cc0-9617-4f76-aa1c-7bd370ea42c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:11.919356 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e41cc0-9617-4f76-aa1c-7bd370ea42c2 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:11.923915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebcbd1-c804-4e20-9acb-8686102c65e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:11.924601 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebcbd1-c804-4e20-9acb-8686102c65e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:11.924854 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebcbd1-c804-4e20-9acb-8686102c65e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:11.925285 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebcbd1-c804-4e20-9acb-8686102c65e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:11.936057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebcbd1-c804-4e20-9acb-8686102c65e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:11.937747 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebcbd1-c804-4e20-9acb-8686102c65e3 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:11.949431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1364/2730] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:12.642707 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba75111-1fc1-43d2-ac7d-a132ce36cb1c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:12.643416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba75111-1fc1-43d2-ac7d-a132ce36cb1c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:12.643954 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba75111-1fc1-43d2-ac7d-a132ce36cb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:12.672567 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-eba75111-1fc1-43d2-ac7d-a132ce36cb1c None None] MFA Rules not processed for user `61f38e7343764429a587313694856204`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:12.673797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-eba75111-1fc1-43d2-ac7d-a132ce36cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:12.750426 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1367/2731] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:12.755220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebcbd1-c804-4e20-9acb-8686102c65e3 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:12.767010 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebcbd1-c804-4e20-9acb-8686102c65e3 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:12.771955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3aba9-c491-4be9-aba8-5e0f0c378e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:12.772634 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3aba9-c491-4be9-aba8-5e0f0c378e94 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:12.773116 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3aba9-c491-4be9-aba8-5e0f0c378e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:12.773411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3aba9-c491-4be9-aba8-5e0f0c378e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:12.774307 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3aba9-c491-4be9-aba8-5e0f0c378e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:12.776557 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3aba9-c491-4be9-aba8-5e0f0c378e94 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:12.804534 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1365/2732] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:07:12 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:12.808812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba75111-1fc1-43d2-ac7d-a132ce36cb1c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:12.820484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba75111-1fc1-43d2-ac7d-a132ce36cb1c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:12.880383 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0bac-8272-4cac-ace5-aa45c209d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:12.881073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0bac-8272-4cac-ace5-aa45c209d793 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:12.881358 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0bac-8272-4cac-ace5-aa45c209d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:12.881634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0bac-8272-4cac-ace5-aa45c209d793 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:12.882371 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0bac-8272-4cac-ace5-aa45c209d793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:12.884338 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0bac-8272-4cac-ace5-aa45c209d793 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:12.909729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1368/2733] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:07:12 2022] POST /identity/v3/users => generated 308 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:12.911273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3aba9-c491-4be9-aba8-5e0f0c378e94 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:12.924519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3aba9-c491-4be9-aba8-5e0f0c378e94 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:12.929645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4fbc1-4039-4ce9-8189-1dce084e4c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:12.930375 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fbc1-4039-4ce9-8189-1dce084e4c57 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:12.930657 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fbc1-4039-4ce9-8189-1dce084e4c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:12.930981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fbc1-4039-4ce9-8189-1dce084e4c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:12.931642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4fbc1-4039-4ce9-8189-1dce084e4c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:12.933353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4fbc1-4039-4ce9-8189-1dce084e4c57 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:12.945540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1366/2734] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:12.950589 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0bac-8272-4cac-ace5-aa45c209d793 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:12.960907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0bac-8272-4cac-ace5-aa45c209d793 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:12.967201 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9ad95-3b9e-4acb-83ff-2ea7dfe3a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:12.968083 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9ad95-3b9e-4acb-83ff-2ea7dfe3a9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:12.968360 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9ad95-3b9e-4acb-83ff-2ea7dfe3a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:12.968637 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9ad95-3b9e-4acb-83ff-2ea7dfe3a9d3 admin admin] PATH_INFO: `/v3/projects/59fca798bd694fd5a2ca67403bb869dc/users/8a74686f58c6492ab8b9a14b98bd908a/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:12.986556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9ad95-3b9e-4acb-83ff-2ea7dfe3a9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fca798bd694fd5a2ca67403bb869dc, user_id=8a74686f58c6492ab8b9a14b98bd908a, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:12.990744 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9ad95-3b9e-4acb-83ff-2ea7dfe3a9d3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:13.010653 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1369/2735] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:12 2022] PUT /identity/v3/projects/59fca798bd694fd5a2ca67403bb869dc/users/8a74686f58c6492ab8b9a14b98bd908a/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:13.015236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4fbc1-4039-4ce9-8189-1dce084e4c57 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:13.026798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4fbc1-4039-4ce9-8189-1dce084e4c57 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:13.109708 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd2ff3-c728-4549-9e42-4e330e38b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:13.110648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2ff3-c728-4549-9e42-4e330e38b570 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:13.111002 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2ff3-c728-4549-9e42-4e330e38b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:13.111339 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd2ff3-c728-4549-9e42-4e330e38b570 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:13.112355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd2ff3-c728-4549-9e42-4e330e38b570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:13.114335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd2ff3-c728-4549-9e42-4e330e38b570 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:13.126883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1367/2736] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:13.131448 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9ad95-3b9e-4acb-83ff-2ea7dfe3a9d3 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:13.142701 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9ad95-3b9e-4acb-83ff-2ea7dfe3a9d3 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:13.147507 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a89b9-3034-4dc7-b2bd-5410c848a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:13.148407 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a89b9-3034-4dc7-b2bd-5410c848a520 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:13.148674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a89b9-3034-4dc7-b2bd-5410c848a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:13.148967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a89b9-3034-4dc7-b2bd-5410c848a520 admin admin] PATH_INFO: `/v3/projects/59fca798bd694fd5a2ca67403bb869dc/users/8a74686f58c6492ab8b9a14b98bd908a/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:13.150999 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a89b9-3034-4dc7-b2bd-5410c848a520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fca798bd694fd5a2ca67403bb869dc, user_id=8a74686f58c6492ab8b9a14b98bd908a, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:13.153723 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a89b9-3034-4dc7-b2bd-5410c848a520 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:13.165449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1370/2737] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:13 2022] PUT /identity/v3/projects/59fca798bd694fd5a2ca67403bb869dc/users/8a74686f58c6492ab8b9a14b98bd908a/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:13.869216 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2845-9542-42df-a0ef-7e8c04bc2d3a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:13.869764 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2845-9542-42df-a0ef-7e8c04bc2d3a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:13.869993 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2845-9542-42df-a0ef-7e8c04bc2d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:13.897782 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-20fc2845-9542-42df-a0ef-7e8c04bc2d3a None None] MFA Rules not processed for user `8a74686f58c6492ab8b9a14b98bd908a`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:13.899223 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-20fc2845-9542-42df-a0ef-7e8c04bc2d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:13.971856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1368/2738] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:15.085498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a89b9-3034-4dc7-b2bd-5410c848a520 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:15.167646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a89b9-3034-4dc7-b2bd-5410c848a520 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:15.172977 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:15.173856 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:15.174173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:15.174452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] PATH_INFO: `/v3/users/61f38e7343764429a587313694856204` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:15.175751 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f38e7343764429a587313694856204)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:15.177672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:15.227152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f38e7343764429a587313694856204'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.227797 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f38e7343764429a587313694856204'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.228551 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f38e7343764429a587313694856204'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.238568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f38e7343764429a587313694856204'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.246044 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f38e7343764429a587313694856204'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.266305 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1371/2739] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:15 2022] DELETE /identity/v3/users/61f38e7343764429a587313694856204 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:15.448362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc2845-9542-42df-a0ef-7e8c04bc2d3a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:15.462555 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc2845-9542-42df-a0ef-7e8c04bc2d3a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:15.534168 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:15.535169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:15.535544 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:15.535829 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] PATH_INFO: `/v3/projects/c775e11dbfb2466c84fc9b4b6319935c` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:15.537283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c775e11dbfb2466c84fc9b4b6319935c)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:15.539622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:15.590979 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c775e11dbfb2466c84fc9b4b6319935c', 'request_id': 'req-0f875944-0b5f-4788-8816-b30bcdb398e4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.599160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c775e11dbfb2466c84fc9b4b6319935c', 'request_id': 'req-0f875944-0b5f-4788-8816-b30bcdb398e4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.610972 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c775e11dbfb2466c84fc9b4b6319935c', 'request_id': 'req-0f875944-0b5f-4788-8816-b30bcdb398e4'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.626332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] The token cache is being invalidate because project c775e11dbfb2466c84fc9b4b6319935c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:15.626595 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.627238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.628810 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1369/2740] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:15 2022] DELETE /identity/v3/projects/c775e11dbfb2466c84fc9b4b6319935c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:15.633187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:15.634777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:15.647866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b6c52-ba8e-476f-b7af-197feee8bee3 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:15.714906 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:15.715796 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:15.716398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:15.716709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] PATH_INFO: `/v3/users/8a74686f58c6492ab8b9a14b98bd908a` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:15.718010 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a74686f58c6492ab8b9a14b98bd908a)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:15.719992 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:15.783803 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a74686f58c6492ab8b9a14b98bd908a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.784514 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a74686f58c6492ab8b9a14b98bd908a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.785276 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a74686f58c6492ab8b9a14b98bd908a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.796069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a74686f58c6492ab8b9a14b98bd908a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.803635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-3adbebba-bb64-4eb1-a6f7-6e5504c3a267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a74686f58c6492ab8b9a14b98bd908a'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:15.825603 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1372/2741] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:15 2022] DELETE /identity/v3/users/8a74686f58c6492ab8b9a14b98bd908a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:16.020201 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:16.021879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:16.035596 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f875944-0b5f-4788-8816-b30bcdb398e4 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:16.103288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:16.104328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.104487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.107005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] PATH_INFO: `/v3/projects/59fca798bd694fd5a2ca67403bb869dc` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.107005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59fca798bd694fd5a2ca67403bb869dc)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:16.108282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:16.159243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59fca798bd694fd5a2ca67403bb869dc', 'request_id': 'req-6e0d10b3-efef-4379-8ca0-08ce94debfa8'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:16.165043 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59fca798bd694fd5a2ca67403bb869dc', 'request_id': 'req-6e0d10b3-efef-4379-8ca0-08ce94debfa8'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:16.174299 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59fca798bd694fd5a2ca67403bb869dc', 'request_id': 'req-6e0d10b3-efef-4379-8ca0-08ce94debfa8'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:16.186160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] The token cache is being invalidate because project 59fca798bd694fd5a2ca67403bb869dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:16.186400 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:16.187211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-6e0d10b3-efef-4379-8ca0-08ce94debfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:16.189806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1370/2742] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:16 2022] DELETE /identity/v3/projects/59fca798bd694fd5a2ca67403bb869dc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:16.196187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11304a28-b70a-4a0f-b4a6-6e094a5ec8c1 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.196737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11304a28-b70a-4a0f-b4a6-6e094a5ec8c1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.196737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11304a28-b70a-4a0f-b4a6-6e094a5ec8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.219958 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-11304a28-b70a-4a0f-b4a6-6e094a5ec8c1 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:16.221693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-11304a28-b70a-4a0f-b4a6-6e094a5ec8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:16.292022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1373/2743] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:07:16.301671 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf17a3-5870-40ec-a771-6c78090108b8 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.301671 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf17a3-5870-40ec-a771-6c78090108b8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.301915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf17a3-5870-40ec-a771-6c78090108b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.322838 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-39bf17a3-5870-40ec-a771-6c78090108b8 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:16.324308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-39bf17a3-5870-40ec-a771-6c78090108b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:16.338703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1371/2744] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:16.343210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11304a28-b70a-4a0f-b4a6-6e094a5ec8c1 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:16.354646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11304a28-b70a-4a0f-b4a6-6e094a5ec8c1 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:16.359165 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94b73-63f3-464f-970b-330d69b67a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:16.359663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94b73-63f3-464f-970b-330d69b67a94 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.360104 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94b73-63f3-464f-970b-330d69b67a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.360222 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94b73-63f3-464f-970b-330d69b67a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.360928 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94b73-63f3-464f-970b-330d69b67a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:07:16.361275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94b73-63f3-464f-970b-330d69b67a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:16.362854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94b73-63f3-464f-970b-330d69b67a94 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:16.375973 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1374/2745] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:07:16.380552 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf17a3-5870-40ec-a771-6c78090108b8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:16.390392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf17a3-5870-40ec-a771-6c78090108b8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:16.395900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187d0a0-9ac0-4436-b58c-cdabafb71bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:16.396542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187d0a0-9ac0-4436-b58c-cdabafb71bad admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.396824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187d0a0-9ac0-4436-b58c-cdabafb71bad admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.397098 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187d0a0-9ac0-4436-b58c-cdabafb71bad admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.397785 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187d0a0-9ac0-4436-b58c-cdabafb71bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:16.399743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187d0a0-9ac0-4436-b58c-cdabafb71bad admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:16.427581 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1372/2746] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:07:16 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:16.431886 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94b73-63f3-464f-970b-330d69b67a94 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:16.442231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94b73-63f3-464f-970b-330d69b67a94 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:16.506142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389dcdc-179d-448d-a3da-026e5ad12b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:16.506811 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389dcdc-179d-448d-a3da-026e5ad12b87 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.507088 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389dcdc-179d-448d-a3da-026e5ad12b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.507318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389dcdc-179d-448d-a3da-026e5ad12b87 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.508054 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389dcdc-179d-448d-a3da-026e5ad12b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:16.509974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389dcdc-179d-448d-a3da-026e5ad12b87 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:16.536365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1375/2747] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:07:16 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:07:16.542174 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187d0a0-9ac0-4436-b58c-cdabafb71bad admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:16.552531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187d0a0-9ac0-4436-b58c-cdabafb71bad admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:16.557230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5e1f6-19b1-4da2-8a4f-ad4c3bac8fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:16.557919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5e1f6-19b1-4da2-8a4f-ad4c3bac8fac admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.558257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5e1f6-19b1-4da2-8a4f-ad4c3bac8fac admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.558735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5e1f6-19b1-4da2-8a4f-ad4c3bac8fac admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.559369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5e1f6-19b1-4da2-8a4f-ad4c3bac8fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:16.560984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5e1f6-19b1-4da2-8a4f-ad4c3bac8fac admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:16.572187 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1373/2748] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:16.576469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389dcdc-179d-448d-a3da-026e5ad12b87 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:16.586889 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389dcdc-179d-448d-a3da-026e5ad12b87 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:16.592339 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a82f43-7443-4c40-ac1f-c9ced794fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:16.592996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a82f43-7443-4c40-ac1f-c9ced794fe18 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.593284 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a82f43-7443-4c40-ac1f-c9ced794fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.593816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a82f43-7443-4c40-ac1f-c9ced794fe18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.594596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a82f43-7443-4c40-ac1f-c9ced794fe18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:16.596169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a82f43-7443-4c40-ac1f-c9ced794fe18 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:16.606655 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1376/2749] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:16.611012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5e1f6-19b1-4da2-8a4f-ad4c3bac8fac admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:16.621578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5e1f6-19b1-4da2-8a4f-ad4c3bac8fac admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:16.626754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489341a-1721-4c15-ad55-3c2534584b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:16.627637 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489341a-1721-4c15-ad55-3c2534584b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.627950 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489341a-1721-4c15-ad55-3c2534584b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.628194 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489341a-1721-4c15-ad55-3c2534584b30 admin admin] PATH_INFO: `/v3/projects/1fe937264b1f4102a0884761e39b662c/users/8c17b0f60de5429bb9bff8880920b69d/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.644656 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489341a-1721-4c15-ad55-3c2534584b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe937264b1f4102a0884761e39b662c, user_id=8c17b0f60de5429bb9bff8880920b69d, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:16.647514 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489341a-1721-4c15-ad55-3c2534584b30 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:16.661792 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1374/2750] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:16 2022] PUT /identity/v3/projects/1fe937264b1f4102a0884761e39b662c/users/8c17b0f60de5429bb9bff8880920b69d/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:16.672577 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555932-fd81-496b-841a-6000458a1a3c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.672867 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555932-fd81-496b-841a-6000458a1a3c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.673146 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555932-fd81-496b-841a-6000458a1a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.700812 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-11555932-fd81-496b-841a-6000458a1a3c None None] MFA Rules not processed for user `8c17b0f60de5429bb9bff8880920b69d`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:16.702091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-11555932-fd81-496b-841a-6000458a1a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:16.767529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1377/2751] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:16.772147 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489341a-1721-4c15-ad55-3c2534584b30 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:16.835129 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489341a-1721-4c15-ad55-3c2534584b30 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:16.843243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf24f-5dc3-41f5-9d28-4fbcd5823028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:16.844031 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf24f-5dc3-41f5-9d28-4fbcd5823028 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.844290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf24f-5dc3-41f5-9d28-4fbcd5823028 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.844563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf24f-5dc3-41f5-9d28-4fbcd5823028 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.845304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf24f-5dc3-41f5-9d28-4fbcd5823028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:16.847289 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf24f-5dc3-41f5-9d28-4fbcd5823028 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:16.875837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1375/2752] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:07:16 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:16.880112 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11555932-fd81-496b-841a-6000458a1a3c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:16.891369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11555932-fd81-496b-841a-6000458a1a3c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:16.955775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e52c64-9a78-40bb-b2b4-322975ac8b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:16.956446 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e52c64-9a78-40bb-b2b4-322975ac8b19 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:16.956730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e52c64-9a78-40bb-b2b4-322975ac8b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:16.957009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e52c64-9a78-40bb-b2b4-322975ac8b19 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:16.957706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e52c64-9a78-40bb-b2b4-322975ac8b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:16.959674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e52c64-9a78-40bb-b2b4-322975ac8b19 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:16.984155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1378/2753] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:07:16 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:16.989748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf24f-5dc3-41f5-9d28-4fbcd5823028 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:17.001202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf24f-5dc3-41f5-9d28-4fbcd5823028 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:17.007091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea40e8-de03-4d2a-a935-f20d2479b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:17.007865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea40e8-de03-4d2a-a935-f20d2479b7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:17.008163 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea40e8-de03-4d2a-a935-f20d2479b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:17.008510 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea40e8-de03-4d2a-a935-f20d2479b7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:17.009293 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea40e8-de03-4d2a-a935-f20d2479b7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:17.011109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea40e8-de03-4d2a-a935-f20d2479b7c2 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:17.023095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1376/2754] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:07:17.028055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e52c64-9a78-40bb-b2b4-322975ac8b19 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:17.044130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e52c64-9a78-40bb-b2b4-322975ac8b19 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:17.052429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4d611-1d47-4991-9598-55001fbc3fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:17.053789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4d611-1d47-4991-9598-55001fbc3fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:17.054205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4d611-1d47-4991-9598-55001fbc3fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:17.054535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4d611-1d47-4991-9598-55001fbc3fbb admin admin] PATH_INFO: `/v3/projects/d872982d7393493dabb0c000cce1f0e4/users/ec70a11810564c428f5e0e2cad0895ab/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:17.072337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4d611-1d47-4991-9598-55001fbc3fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d872982d7393493dabb0c000cce1f0e4, user_id=ec70a11810564c428f5e0e2cad0895ab, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:17.075463 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4d611-1d47-4991-9598-55001fbc3fbb admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:17.095388 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1379/2755] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:17 2022] PUT /identity/v3/projects/d872982d7393493dabb0c000cce1f0e4/users/ec70a11810564c428f5e0e2cad0895ab/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:07:17.100879 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea40e8-de03-4d2a-a935-f20d2479b7c2 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:17.111807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea40e8-de03-4d2a-a935-f20d2479b7c2 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:17.174894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c02fe0-372a-49f1-8095-02c0b1c1d0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:17.175858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c02fe0-372a-49f1-8095-02c0b1c1d0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:17.176257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c02fe0-372a-49f1-8095-02c0b1c1d0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:17.176586 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c02fe0-372a-49f1-8095-02c0b1c1d0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:17.177476 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c02fe0-372a-49f1-8095-02c0b1c1d0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:17.179729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c02fe0-372a-49f1-8095-02c0b1c1d0a7 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:17.192032 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1377/2756] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:17.198936 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4d611-1d47-4991-9598-55001fbc3fbb admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:17.209868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4d611-1d47-4991-9598-55001fbc3fbb admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:17.216674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551f0b8-ecf7-4cfb-8a15-9c74f12f5769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:17.217607 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551f0b8-ecf7-4cfb-8a15-9c74f12f5769 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:17.217887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551f0b8-ecf7-4cfb-8a15-9c74f12f5769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:17.218205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551f0b8-ecf7-4cfb-8a15-9c74f12f5769 admin admin] PATH_INFO: `/v3/projects/d872982d7393493dabb0c000cce1f0e4/users/ec70a11810564c428f5e0e2cad0895ab/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:17.229422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551f0b8-ecf7-4cfb-8a15-9c74f12f5769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d872982d7393493dabb0c000cce1f0e4, user_id=ec70a11810564c428f5e0e2cad0895ab, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:17.232342 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551f0b8-ecf7-4cfb-8a15-9c74f12f5769 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:17.249456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1380/2757] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:17 2022] PUT /identity/v3/projects/d872982d7393493dabb0c000cce1f0e4/users/ec70a11810564c428f5e0e2cad0895ab/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:17.261012 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b56618-ca87-437f-8f7e-ed5163f1dbf8 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:17.261320 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b56618-ca87-437f-8f7e-ed5163f1dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:17.261577 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b56618-ca87-437f-8f7e-ed5163f1dbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:17.293516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-57b56618-ca87-437f-8f7e-ed5163f1dbf8 None None] MFA Rules not processed for user `ec70a11810564c428f5e0e2cad0895ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:17.294748 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-57b56618-ca87-437f-8f7e-ed5163f1dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:17.372542 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1378/2758] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:17.384108 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551f0b8-ecf7-4cfb-8a15-9c74f12f5769 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:17.386065 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1551f0b8-ecf7-4cfb-8a15-9c74f12f5769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:17.455378 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551f0b8-ecf7-4cfb-8a15-9c74f12f5769 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:17.459405 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c6b6-252b-4af7-9a2f-4ffa9cb57546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:17.460085 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c6b6-252b-4af7-9a2f-4ffa9cb57546 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:17.460369 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c6b6-252b-4af7-9a2f-4ffa9cb57546 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:17.460651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c6b6-252b-4af7-9a2f-4ffa9cb57546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:17.470131 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c6b6-252b-4af7-9a2f-4ffa9cb57546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:17.471585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c6b6-252b-4af7-9a2f-4ffa9cb57546 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:17.481275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1381/2759] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:17.557283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b56618-ca87-437f-8f7e-ed5163f1dbf8 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:17.567974 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b56618-ca87-437f-8f7e-ed5163f1dbf8 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:17.572119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da50a2f-3437-4edd-8974-b077e038f37d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:17.572763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da50a2f-3437-4edd-8974-b077e038f37d service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:17.573041 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da50a2f-3437-4edd-8974-b077e038f37d service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:17.573315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da50a2f-3437-4edd-8974-b077e038f37d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:17.637079 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da50a2f-3437-4edd-8974-b077e038f37d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:17.638480 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da50a2f-3437-4edd-8974-b077e038f37d service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:17.648136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1379/2760] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:20.439630 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c6b6-252b-4af7-9a2f-4ffa9cb57546 service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:20.508295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c6b6-252b-4af7-9a2f-4ffa9cb57546 service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:20.514572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:20.515472 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:20.515779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:20.516015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] PATH_INFO: `/v3/users/8c17b0f60de5429bb9bff8880920b69d` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:20.517425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c17b0f60de5429bb9bff8880920b69d)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:20.519631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:20.572191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c17b0f60de5429bb9bff8880920b69d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:20.572945 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c17b0f60de5429bb9bff8880920b69d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:20.573598 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c17b0f60de5429bb9bff8880920b69d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:20.582631 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c17b0f60de5429bb9bff8880920b69d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:20.589712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c17b0f60de5429bb9bff8880920b69d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:20.607945 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1382/2761] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:20 2022] DELETE /identity/v3/users/8c17b0f60de5429bb9bff8880920b69d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:20.612589 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2282b-6a22-4a17-a8c8-12344e54b276 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:20.613090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2282b-6a22-4a17-a8c8-12344e54b276 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:20.613090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2282b-6a22-4a17-a8c8-12344e54b276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:20.632027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-65b2282b-6a22-4a17-a8c8-12344e54b276 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:20.633234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-65b2282b-6a22-4a17-a8c8-12344e54b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:20.697152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1380/2762] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:20.707760 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:20.709817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:20.773408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce39d9c-e837-44d4-8385-53edf5042498 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:20.777708 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f384db-cc96-44b6-9279-114173e45d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:20.778519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f384db-cc96-44b6-9279-114173e45d16 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:20.778810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f384db-cc96-44b6-9279-114173e45d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:20.779093 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f384db-cc96-44b6-9279-114173e45d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:20.788556 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f384db-cc96-44b6-9279-114173e45d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:20.790009 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f384db-cc96-44b6-9279-114173e45d16 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:20.799869 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1383/2763] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:21.110630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2282b-6a22-4a17-a8c8-12344e54b276 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:21.112106 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-65b2282b-6a22-4a17-a8c8-12344e54b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:21.124506 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2282b-6a22-4a17-a8c8-12344e54b276 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:21.130956 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:21.131766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:21.131766 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:21.132135 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] PATH_INFO: `/v3/projects/1fe937264b1f4102a0884761e39b662c` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:21.133599 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe937264b1f4102a0884761e39b662c)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:21.135580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:21.184525 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe937264b1f4102a0884761e39b662c', 'request_id': 'req-ddc8e728-3a2a-4309-92e8-8b41b194591a'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.189760 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe937264b1f4102a0884761e39b662c', 'request_id': 'req-ddc8e728-3a2a-4309-92e8-8b41b194591a'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.198148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe937264b1f4102a0884761e39b662c', 'request_id': 'req-ddc8e728-3a2a-4309-92e8-8b41b194591a'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.210239 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] The token cache is being invalidate because project 1fe937264b1f4102a0884761e39b662c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:21.210519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.211235 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.212833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1381/2764] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:21 2022] DELETE /identity/v3/projects/1fe937264b1f4102a0884761e39b662c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:21.217647 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f384db-cc96-44b6-9279-114173e45d16 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:21.228297 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f384db-cc96-44b6-9279-114173e45d16 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:21.287875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:21.288753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:21.289031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:21.289301 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] PATH_INFO: `/v3/users/ec70a11810564c428f5e0e2cad0895ab` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:21.290518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec70a11810564c428f5e0e2cad0895ab)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:21.292528 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:21.341484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec70a11810564c428f5e0e2cad0895ab'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.342157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec70a11810564c428f5e0e2cad0895ab'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.342823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec70a11810564c428f5e0e2cad0895ab'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.350907 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec70a11810564c428f5e0e2cad0895ab'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.357881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-9a439f2f-ed32-4e18-b42e-435cad2a1ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec70a11810564c428f5e0e2cad0895ab'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.374566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1384/2765] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:21 2022] DELETE /identity/v3/users/ec70a11810564c428f5e0e2cad0895ab => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:21.667867 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:21.669306 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:21.683254 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8e728-3a2a-4309-92e8-8b41b194591a admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:21.744915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:21.746111 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:21.746393 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:21.746695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] PATH_INFO: `/v3/projects/d872982d7393493dabb0c000cce1f0e4` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:21.748580 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d872982d7393493dabb0c000cce1f0e4)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:21.751660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:21.805424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd872982d7393493dabb0c000cce1f0e4', 'request_id': 'req-32e82e79-64e4-4dff-8a32-8031e60d64b3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.813568 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd872982d7393493dabb0c000cce1f0e4', 'request_id': 'req-32e82e79-64e4-4dff-8a32-8031e60d64b3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.825720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd872982d7393493dabb0c000cce1f0e4', 'request_id': 'req-32e82e79-64e4-4dff-8a32-8031e60d64b3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.838082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] The token cache is being invalidate because project d872982d7393493dabb0c000cce1f0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:21.838369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.839069 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-32e82e79-64e4-4dff-8a32-8031e60d64b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:21.840958 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1382/2766] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:21 2022] DELETE /identity/v3/projects/d872982d7393493dabb0c000cce1f0e4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:21.846570 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500af1e4-7c87-44cc-ac6f-f36890a788d4 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:21.847029 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500af1e4-7c87-44cc-ac6f-f36890a788d4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:21.847270 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500af1e4-7c87-44cc-ac6f-f36890a788d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:21.868685 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-500af1e4-7c87-44cc-ac6f-f36890a788d4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:21.869842 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-500af1e4-7c87-44cc-ac6f-f36890a788d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:21.934109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1385/2767] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:21.942535 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce98cc-efd5-4844-ac80-b5539bfa35a4 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:21.942826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce98cc-efd5-4844-ac80-b5539bfa35a4 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:21.943108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce98cc-efd5-4844-ac80-b5539bfa35a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:21.962316 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-96ce98cc-efd5-4844-ac80-b5539bfa35a4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:21.963499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-96ce98cc-efd5-4844-ac80-b5539bfa35a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:21.973584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1383/2768] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:21.977991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500af1e4-7c87-44cc-ac6f-f36890a788d4 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:21.988017 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500af1e4-7c87-44cc-ac6f-f36890a788d4 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:21.993429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb419187-1ceb-4812-9716-054b9125b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:21.994129 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb419187-1ceb-4812-9716-054b9125b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:21.994429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb419187-1ceb-4812-9716-054b9125b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:21.994683 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb419187-1ceb-4812-9716-054b9125b5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:21.995460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb419187-1ceb-4812-9716-054b9125b5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:07:21.995770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb419187-1ceb-4812-9716-054b9125b5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:21.997411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb419187-1ceb-4812-9716-054b9125b5d1 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.009357 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1386/2769] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:07:22.014864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce98cc-efd5-4844-ac80-b5539bfa35a4 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.027105 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce98cc-efd5-4844-ac80-b5539bfa35a4 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.033296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b5d48-7abd-48f3-8b1a-48a85e6d2e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.034416 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b5d48-7abd-48f3-8b1a-48a85e6d2e31 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.034856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b5d48-7abd-48f3-8b1a-48a85e6d2e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.035234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b5d48-7abd-48f3-8b1a-48a85e6d2e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.036342 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b5d48-7abd-48f3-8b1a-48a85e6d2e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.039698 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b5d48-7abd-48f3-8b1a-48a85e6d2e31 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.074612 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1384/2770] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:07:22 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:22.079235 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb419187-1ceb-4812-9716-054b9125b5d1 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.090739 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb419187-1ceb-4812-9716-054b9125b5d1 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.152494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41838df9-beb7-443a-b3da-7500dcaf3543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.153109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41838df9-beb7-443a-b3da-7500dcaf3543 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.153393 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41838df9-beb7-443a-b3da-7500dcaf3543 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.153670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41838df9-beb7-443a-b3da-7500dcaf3543 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.154402 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41838df9-beb7-443a-b3da-7500dcaf3543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.156326 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41838df9-beb7-443a-b3da-7500dcaf3543 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.179939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1387/2771] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:07:22 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:22.182993 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b5d48-7abd-48f3-8b1a-48a85e6d2e31 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.194323 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b5d48-7abd-48f3-8b1a-48a85e6d2e31 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.200802 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e033c66-6852-4f62-9bc7-443e925d2f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.201536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033c66-6852-4f62-9bc7-443e925d2f42 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.201841 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033c66-6852-4f62-9bc7-443e925d2f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.202132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033c66-6852-4f62-9bc7-443e925d2f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.202900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e033c66-6852-4f62-9bc7-443e925d2f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.204558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e033c66-6852-4f62-9bc7-443e925d2f42 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.217210 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1385/2772] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:22.222896 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41838df9-beb7-443a-b3da-7500dcaf3543 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.241089 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41838df9-beb7-443a-b3da-7500dcaf3543 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.253609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfdc31-4022-49fe-8fc1-f18b2df249ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.254349 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfdc31-4022-49fe-8fc1-f18b2df249ad admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.254634 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfdc31-4022-49fe-8fc1-f18b2df249ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.254909 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfdc31-4022-49fe-8fc1-f18b2df249ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.255650 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfdc31-4022-49fe-8fc1-f18b2df249ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.257271 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfdc31-4022-49fe-8fc1-f18b2df249ad admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.269007 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1388/2773] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:22.274144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e033c66-6852-4f62-9bc7-443e925d2f42 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.286711 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e033c66-6852-4f62-9bc7-443e925d2f42 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.291777 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02ce70-4feb-418b-9f4c-001090bdee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.293148 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02ce70-4feb-418b-9f4c-001090bdee90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.293429 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02ce70-4feb-418b-9f4c-001090bdee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.293731 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02ce70-4feb-418b-9f4c-001090bdee90 admin admin] PATH_INFO: `/v3/projects/8d3cca2511c746c3b53204d6ea4840ae/users/d4f6a08f29e341638cd272b405b996f3/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.309391 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02ce70-4feb-418b-9f4c-001090bdee90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3cca2511c746c3b53204d6ea4840ae, user_id=d4f6a08f29e341638cd272b405b996f3, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.312065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02ce70-4feb-418b-9f4c-001090bdee90 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.326466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1386/2774] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:22 2022] PUT /identity/v3/projects/8d3cca2511c746c3b53204d6ea4840ae/users/d4f6a08f29e341638cd272b405b996f3/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:22.337274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a32b-668b-401f-a7f3-8820607cdb7b None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.337564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a32b-668b-401f-a7f3-8820607cdb7b None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.337844 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a32b-668b-401f-a7f3-8820607cdb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.368654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-6663a32b-668b-401f-a7f3-8820607cdb7b None None] MFA Rules not processed for user `d4f6a08f29e341638cd272b405b996f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:22.369863 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6663a32b-668b-401f-a7f3-8820607cdb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:22.437374 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1389/2775] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:22.444152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02ce70-4feb-418b-9f4c-001090bdee90 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.524576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02ce70-4feb-418b-9f4c-001090bdee90 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.533798 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f6d81-4e51-4a90-9147-bbbe973cdd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.534746 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f6d81-4e51-4a90-9147-bbbe973cdd1f admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.535103 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f6d81-4e51-4a90-9147-bbbe973cdd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.535438 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f6d81-4e51-4a90-9147-bbbe973cdd1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.536468 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f6d81-4e51-4a90-9147-bbbe973cdd1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.539491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f6d81-4e51-4a90-9147-bbbe973cdd1f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.569591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1387/2776] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:07:22 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:22.574078 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a32b-668b-401f-a7f3-8820607cdb7b None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.586878 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a32b-668b-401f-a7f3-8820607cdb7b None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.653456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ec112-13e5-497c-8b07-3e8b96f60b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.654156 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ec112-13e5-497c-8b07-3e8b96f60b30 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.654445 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ec112-13e5-497c-8b07-3e8b96f60b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.654725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ec112-13e5-497c-8b07-3e8b96f60b30 admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.655416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ec112-13e5-497c-8b07-3e8b96f60b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.657328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ec112-13e5-497c-8b07-3e8b96f60b30 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.680020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1390/2777] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:07:22 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:22.685271 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f6d81-4e51-4a90-9147-bbbe973cdd1f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.695811 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f6d81-4e51-4a90-9147-bbbe973cdd1f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.701189 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b2374-a8bb-49a2-9836-35952c7cabd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.701858 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b2374-a8bb-49a2-9836-35952c7cabd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.702190 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b2374-a8bb-49a2-9836-35952c7cabd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.702463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b2374-a8bb-49a2-9836-35952c7cabd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.703164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b2374-a8bb-49a2-9836-35952c7cabd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.704763 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b2374-a8bb-49a2-9836-35952c7cabd8 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.715498 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1388/2778] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:22.719968 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ec112-13e5-497c-8b07-3e8b96f60b30 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.730672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ec112-13e5-497c-8b07-3e8b96f60b30 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.736267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad45c2-58f2-4ff2-b355-85c399178de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.737161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad45c2-58f2-4ff2-b355-85c399178de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.737425 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad45c2-58f2-4ff2-b355-85c399178de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.737700 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad45c2-58f2-4ff2-b355-85c399178de5 admin admin] PATH_INFO: `/v3/projects/a37a51f5d162463085bf394a396e09c8/users/d92e94bd41e74a91baf51cf71d14c41e/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.753970 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad45c2-58f2-4ff2-b355-85c399178de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37a51f5d162463085bf394a396e09c8, user_id=d92e94bd41e74a91baf51cf71d14c41e, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.756609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad45c2-58f2-4ff2-b355-85c399178de5 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.770883 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1391/2779] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:22 2022] PUT /identity/v3/projects/a37a51f5d162463085bf394a396e09c8/users/d92e94bd41e74a91baf51cf71d14c41e/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:22.775715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b2374-a8bb-49a2-9836-35952c7cabd8 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.790688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b2374-a8bb-49a2-9836-35952c7cabd8 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.848842 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f200250-87fc-4684-b2f3-f146f2352724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.849524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f200250-87fc-4684-b2f3-f146f2352724 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.849807 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f200250-87fc-4684-b2f3-f146f2352724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.850113 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f200250-87fc-4684-b2f3-f146f2352724 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.850865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f200250-87fc-4684-b2f3-f146f2352724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.852475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f200250-87fc-4684-b2f3-f146f2352724 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.862350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1389/2780] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:07:22.866654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad45c2-58f2-4ff2-b355-85c399178de5 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:22.877746 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad45c2-58f2-4ff2-b355-85c399178de5 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:22.882328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde65336-7760-43ba-8053-3632dc7ef272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:22.883314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde65336-7760-43ba-8053-3632dc7ef272 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.883596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde65336-7760-43ba-8053-3632dc7ef272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.883874 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde65336-7760-43ba-8053-3632dc7ef272 admin admin] PATH_INFO: `/v3/projects/a37a51f5d162463085bf394a396e09c8/users/d92e94bd41e74a91baf51cf71d14c41e/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.885868 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde65336-7760-43ba-8053-3632dc7ef272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37a51f5d162463085bf394a396e09c8, user_id=d92e94bd41e74a91baf51cf71d14c41e, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:22.888572 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde65336-7760-43ba-8053-3632dc7ef272 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:22.900039 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1392/2781] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:22 2022] PUT /identity/v3/projects/a37a51f5d162463085bf394a396e09c8/users/d92e94bd41e74a91baf51cf71d14c41e/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:22.912516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861cd9-d53c-4773-bf94-10f6e588b836 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:22.912960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861cd9-d53c-4773-bf94-10f6e588b836 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:22.913321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861cd9-d53c-4773-bf94-10f6e588b836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:22.947443 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-5d861cd9-d53c-4773-bf94-10f6e588b836 None None] MFA Rules not processed for user `d92e94bd41e74a91baf51cf71d14c41e`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:22.948851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5d861cd9-d53c-4773-bf94-10f6e588b836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:23.025195 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1390/2782] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:23.037674 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde65336-7760-43ba-8053-3632dc7ef272 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:23.040422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-bde65336-7760-43ba-8053-3632dc7ef272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:23.106651 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde65336-7760-43ba-8053-3632dc7ef272 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:23.111394 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb0185-b94c-4ce7-8078-0b10fe99e706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:23.112047 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb0185-b94c-4ce7-8078-0b10fe99e706 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:23.112327 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb0185-b94c-4ce7-8078-0b10fe99e706 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:23.112608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb0185-b94c-4ce7-8078-0b10fe99e706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:23.186470 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb0185-b94c-4ce7-8078-0b10fe99e706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:23.188225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb0185-b94c-4ce7-8078-0b10fe99e706 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:23.198815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1393/2783] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:26.801278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d861cd9-d53c-4773-bf94-10f6e588b836 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:26.877155 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d861cd9-d53c-4773-bf94-10f6e588b836 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:26.882443 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:26.883325 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:26.883609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:26.883883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] PATH_INFO: `/v3/users/d4f6a08f29e341638cd272b405b996f3` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:26.885175 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f6a08f29e341638cd272b405b996f3)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:26.887309 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:26.933860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f6a08f29e341638cd272b405b996f3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:26.947955 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f6a08f29e341638cd272b405b996f3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:26.957518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f6a08f29e341638cd272b405b996f3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:26.958352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f6a08f29e341638cd272b405b996f3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:26.967005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f6a08f29e341638cd272b405b996f3'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:26.975968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1391/2784] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:26 2022] DELETE /identity/v3/users/d4f6a08f29e341638cd272b405b996f3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:26.982905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b211e-8624-4746-9bfe-46f24a5c1b5c None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:26.983433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b211e-8624-4746-9bfe-46f24a5c1b5c None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:26.983433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b211e-8624-4746-9bfe-46f24a5c1b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:27.009157 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1b6b211e-8624-4746-9bfe-46f24a5c1b5c None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:27.011117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1b6b211e-8624-4746-9bfe-46f24a5c1b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:27.075810 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1394/2785] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:07:27.086388 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:27.088471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:27.150486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cc1e-40db-48ba-9c95-dbb696643f63 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:27.155082 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad7dae-1881-4598-a71b-28ccfc4c258d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:27.155741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad7dae-1881-4598-a71b-28ccfc4c258d service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:27.156093 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad7dae-1881-4598-a71b-28ccfc4c258d service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:27.156278 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad7dae-1881-4598-a71b-28ccfc4c258d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:27.165516 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad7dae-1881-4598-a71b-28ccfc4c258d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:27.166997 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad7dae-1881-4598-a71b-28ccfc4c258d service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:27.176487 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1392/2786] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:27.468564 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b211e-8624-4746-9bfe-46f24a5c1b5c None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:27.470198 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1b6b211e-8624-4746-9bfe-46f24a5c1b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:27.483253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b211e-8624-4746-9bfe-46f24a5c1b5c None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:27.488892 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:27.489767 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:27.490081 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:27.490492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] PATH_INFO: `/v3/projects/8d3cca2511c746c3b53204d6ea4840ae` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:27.491680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3cca2511c746c3b53204d6ea4840ae)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:27.493659 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:27.544155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3cca2511c746c3b53204d6ea4840ae', 'request_id': 'req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.549511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3cca2511c746c3b53204d6ea4840ae', 'request_id': 'req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.555625 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3cca2511c746c3b53204d6ea4840ae', 'request_id': 'req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.569532 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] The token cache is being invalidate because project 8d3cca2511c746c3b53204d6ea4840ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:27.569813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.570465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.572043 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1395/2787] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:27 2022] DELETE /identity/v3/projects/8d3cca2511c746c3b53204d6ea4840ae => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:27.576632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad7dae-1881-4598-a71b-28ccfc4c258d service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:27.586594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad7dae-1881-4598-a71b-28ccfc4c258d service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:27.654456 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:27.655877 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:27.656119 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:27.656394 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] PATH_INFO: `/v3/users/d92e94bd41e74a91baf51cf71d14c41e` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:27.657696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92e94bd41e74a91baf51cf71d14c41e)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:27.659937 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:27.719821 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92e94bd41e74a91baf51cf71d14c41e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.731981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92e94bd41e74a91baf51cf71d14c41e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.741978 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92e94bd41e74a91baf51cf71d14c41e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.743095 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92e94bd41e74a91baf51cf71d14c41e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.751697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-3dbe5a40-0dab-46f5-bd7b-d5e24a2e326a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92e94bd41e74a91baf51cf71d14c41e'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:27.758645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1393/2788] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:27 2022] DELETE /identity/v3/users/d92e94bd41e74a91baf51cf71d14c41e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:28.067561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:28.069169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:28.084793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff9d0e-c8d0-48a5-87c6-360d59a1147d admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:28.146315 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:28.147184 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.147498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.147780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] PATH_INFO: `/v3/projects/a37a51f5d162463085bf394a396e09c8` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.149008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a37a51f5d162463085bf394a396e09c8)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:28.151039 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:28.203939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a37a51f5d162463085bf394a396e09c8', 'request_id': 'req-fd474541-3f38-4bc6-a20a-84a9a1e602aa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:28.209688 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a37a51f5d162463085bf394a396e09c8', 'request_id': 'req-fd474541-3f38-4bc6-a20a-84a9a1e602aa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:28.216858 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a37a51f5d162463085bf394a396e09c8', 'request_id': 'req-fd474541-3f38-4bc6-a20a-84a9a1e602aa'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:28.234020 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] The token cache is being invalidate because project a37a51f5d162463085bf394a396e09c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:28.234398 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:28.235595 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-fd474541-3f38-4bc6-a20a-84a9a1e602aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:28.238059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1396/2789] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:28 2022] DELETE /identity/v3/projects/a37a51f5d162463085bf394a396e09c8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:28.245837 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcab727-0441-4b9c-be63-1b9855a40042 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.246570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcab727-0441-4b9c-be63-1b9855a40042 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.246570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcab727-0441-4b9c-be63-1b9855a40042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.266981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-cbcab727-0441-4b9c-be63-1b9855a40042 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:28.268179 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cbcab727-0441-4b9c-be63-1b9855a40042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:28.334930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1394/2790] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:28.343679 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23181d-1c78-436b-86f9-ae8c43834cb2 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.343964 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23181d-1c78-436b-86f9-ae8c43834cb2 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.344246 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23181d-1c78-436b-86f9-ae8c43834cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.363091 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-5b23181d-1c78-436b-86f9-ae8c43834cb2 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:28.364206 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-5b23181d-1c78-436b-86f9-ae8c43834cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:28.377261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1397/2791] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:28.381836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcab727-0441-4b9c-be63-1b9855a40042 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:28.394951 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcab727-0441-4b9c-be63-1b9855a40042 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:28.402351 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cf8a9-b505-4302-9add-c19ea1cdf8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:28.403018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cf8a9-b505-4302-9add-c19ea1cdf8ff admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.403327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cf8a9-b505-4302-9add-c19ea1cdf8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.403605 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cf8a9-b505-4302-9add-c19ea1cdf8ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.404336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cf8a9-b505-4302-9add-c19ea1cdf8ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:07:28.404663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cf8a9-b505-4302-9add-c19ea1cdf8ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:28.406346 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cf8a9-b505-4302-9add-c19ea1cdf8ff admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:28.419330 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1395/2792] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:07:28.425602 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23181d-1c78-436b-86f9-ae8c43834cb2 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:28.435969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23181d-1c78-436b-86f9-ae8c43834cb2 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:28.441062 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4e5bb-06bc-44ca-b706-52725369ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:28.441725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4e5bb-06bc-44ca-b706-52725369ce5b admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.442038 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4e5bb-06bc-44ca-b706-52725369ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.442319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4e5bb-06bc-44ca-b706-52725369ce5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.443031 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4e5bb-06bc-44ca-b706-52725369ce5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:28.444982 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4e5bb-06bc-44ca-b706-52725369ce5b admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:28.476950 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1398/2793] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:07:28 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:28.481644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cf8a9-b505-4302-9add-c19ea1cdf8ff admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:28.492162 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cf8a9-b505-4302-9add-c19ea1cdf8ff admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:28.551663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b22ca-7f4c-49dc-99a4-4f36471d343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:28.552327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b22ca-7f4c-49dc-99a4-4f36471d343d admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.552615 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b22ca-7f4c-49dc-99a4-4f36471d343d admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.552890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b22ca-7f4c-49dc-99a4-4f36471d343d admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.553574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b22ca-7f4c-49dc-99a4-4f36471d343d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:28.555520 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b22ca-7f4c-49dc-99a4-4f36471d343d admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:28.577965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1396/2794] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:07:28 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:28.582300 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4e5bb-06bc-44ca-b706-52725369ce5b admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:28.593319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4e5bb-06bc-44ca-b706-52725369ce5b admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:28.598231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99a259-b343-47b6-aea9-f8687de1a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:28.598902 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99a259-b343-47b6-aea9-f8687de1a1be admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.599126 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99a259-b343-47b6-aea9-f8687de1a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.599396 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99a259-b343-47b6-aea9-f8687de1a1be admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.600113 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99a259-b343-47b6-aea9-f8687de1a1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:28.601693 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99a259-b343-47b6-aea9-f8687de1a1be admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:28.612787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1399/2795] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:28.619053 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b22ca-7f4c-49dc-99a4-4f36471d343d admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:28.629622 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b22ca-7f4c-49dc-99a4-4f36471d343d admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:28.634817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d8a51-e7c4-4bf1-b500-b0f143f54ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:28.635470 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d8a51-e7c4-4bf1-b500-b0f143f54ead admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.635750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d8a51-e7c4-4bf1-b500-b0f143f54ead admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.636083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d8a51-e7c4-4bf1-b500-b0f143f54ead admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.636851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d8a51-e7c4-4bf1-b500-b0f143f54ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:28.638486 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d8a51-e7c4-4bf1-b500-b0f143f54ead admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:28.650037 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1397/2796] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:28.656237 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99a259-b343-47b6-aea9-f8687de1a1be admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:28.666993 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99a259-b343-47b6-aea9-f8687de1a1be admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:28.672494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bc841-fdb7-47e8-88ab-786e2eb643e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:28.673384 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc841-fdb7-47e8-88ab-786e2eb643e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.673658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc841-fdb7-47e8-88ab-786e2eb643e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.673927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc841-fdb7-47e8-88ab-786e2eb643e4 admin admin] PATH_INFO: `/v3/projects/5fb9130a5732482897b161fa7d2115e5/users/c84e767163684e53aff0986bb70d8b0c/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.689911 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bc841-fdb7-47e8-88ab-786e2eb643e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb9130a5732482897b161fa7d2115e5, user_id=c84e767163684e53aff0986bb70d8b0c, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:28.692648 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bc841-fdb7-47e8-88ab-786e2eb643e4 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:28.707550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1400/2797] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:28 2022] PUT /identity/v3/projects/5fb9130a5732482897b161fa7d2115e5/users/c84e767163684e53aff0986bb70d8b0c/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:28.719896 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c435-6996-4e82-9284-0580ce7976aa None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.720197 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c435-6996-4e82-9284-0580ce7976aa None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.720435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c435-6996-4e82-9284-0580ce7976aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.751861 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-cf28c435-6996-4e82-9284-0580ce7976aa None None] MFA Rules not processed for user `c84e767163684e53aff0986bb70d8b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:28.753067 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cf28c435-6996-4e82-9284-0580ce7976aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:28.822485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1398/2798] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:28.834156 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bc841-fdb7-47e8-88ab-786e2eb643e4 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:28.835917 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-858bc841-fdb7-47e8-88ab-786e2eb643e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:28.895831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bc841-fdb7-47e8-88ab-786e2eb643e4 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:28.899985 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f845-ebeb-4dfa-9b92-6c3e6b63e2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:28.900663 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f845-ebeb-4dfa-9b92-6c3e6b63e2ae service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:28.900913 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f845-ebeb-4dfa-9b92-6c3e6b63e2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:28.901185 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f845-ebeb-4dfa-9b92-6c3e6b63e2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:28.914801 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337f845-ebeb-4dfa-9b92-6c3e6b63e2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:28.917008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337f845-ebeb-4dfa-9b92-6c3e6b63e2ae service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:28.932956 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1401/2799] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:31.366244 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1511e5b-94f4-4271-874c-cff97fd75403 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:31.366826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1511e5b-94f4-4271-874c-cff97fd75403 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:31.366826 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1511e5b-94f4-4271-874c-cff97fd75403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:31.384570 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-f1511e5b-94f4-4271-874c-cff97fd75403 None None] MFA Rules not processed for user `c84e767163684e53aff0986bb70d8b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:31.385779 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f1511e5b-94f4-4271-874c-cff97fd75403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:31.393703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1399/2800] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:32.340835 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f845-ebeb-4dfa-9b92-6c3e6b63e2ae service cinder] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:32.342988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-c337f845-ebeb-4dfa-9b92-6c3e6b63e2ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:32.458352 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f845-ebeb-4dfa-9b92-6c3e6b63e2ae service cinder] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:32.464355 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b18b-f822-48ea-a486-1351d78f5f4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:32.465461 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b18b-f822-48ea-a486-1351d78f5f4c service placement] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:32.465743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b18b-f822-48ea-a486-1351d78f5f4c service placement] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:32.466049 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b18b-f822-48ea-a486-1351d78f5f4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:32.468527 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-e8b4b18b-f822-48ea-a486-1351d78f5f4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:32.480956 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4b18b-f822-48ea-a486-1351d78f5f4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:32.482584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4b18b-f822-48ea-a486-1351d78f5f4c service placement] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:32.492540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1402/2801] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:36.084780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1511e5b-94f4-4271-874c-cff97fd75403 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:36.086474 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f1511e5b-94f4-4271-874c-cff97fd75403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:36.150311 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1511e5b-94f4-4271-874c-cff97fd75403 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:36.155709 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:36.156584 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:36.156864 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:36.157131 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] PATH_INFO: `/v3/users/4988912db9e8432cb87723dd81f18f3b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:36.158390 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4988912db9e8432cb87723dd81f18f3b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:36.160318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:36.209664 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4988912db9e8432cb87723dd81f18f3b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.221676 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4988912db9e8432cb87723dd81f18f3b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.231081 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4988912db9e8432cb87723dd81f18f3b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.231750 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4988912db9e8432cb87723dd81f18f3b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.239073 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4988912db9e8432cb87723dd81f18f3b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.244910 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1400/2802] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:36 2022] DELETE /identity/v3/users/4988912db9e8432cb87723dd81f18f3b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:36.249535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91aa9-754e-401e-a5c9-fe9d2f41553a None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:36.250077 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91aa9-754e-401e-a5c9-fe9d2f41553a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:36.250191 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91aa9-754e-401e-a5c9-fe9d2f41553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:36.268583 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4db91aa9-754e-401e-a5c9-fe9d2f41553a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:36.269804 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4db91aa9-754e-401e-a5c9-fe9d2f41553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:36.326974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1403/2803] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:36.336831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:36.338322 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:36.408860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6565f0-4823-44ab-b5b9-8853dbe9aea6 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:36.413554 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd39ce6-4324-4bdb-a6a3-41455a5c7a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:36.414248 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd39ce6-4324-4bdb-a6a3-41455a5c7a31 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:36.414535 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd39ce6-4324-4bdb-a6a3-41455a5c7a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:36.414814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd39ce6-4324-4bdb-a6a3-41455a5c7a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:36.425050 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd39ce6-4324-4bdb-a6a3-41455a5c7a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:36.426548 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd39ce6-4324-4bdb-a6a3-41455a5c7a31 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:36.436831 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1401/2804] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:36.793263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91aa9-754e-401e-a5c9-fe9d2f41553a None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:36.794745 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4db91aa9-754e-401e-a5c9-fe9d2f41553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:36.809429 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91aa9-754e-401e-a5c9-fe9d2f41553a None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:36.814504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:36.816144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:36.816806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:36.817086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] PATH_INFO: `/v3/projects/c699b2512029498981a9e7d2592a306b` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:36.819277 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c699b2512029498981a9e7d2592a306b)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:36.821161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:36.890878 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c699b2512029498981a9e7d2592a306b', 'request_id': 'req-eeb18a52-d7e8-45d6-952a-873995303109'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.896612 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c699b2512029498981a9e7d2592a306b', 'request_id': 'req-eeb18a52-d7e8-45d6-952a-873995303109'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.903331 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c699b2512029498981a9e7d2592a306b', 'request_id': 'req-eeb18a52-d7e8-45d6-952a-873995303109'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.917416 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] The token cache is being invalidate because project c699b2512029498981a9e7d2592a306b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:36.917711 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.918417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:36.920008 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1404/2805] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:36 2022] DELETE /identity/v3/projects/c699b2512029498981a9e7d2592a306b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:50.039814 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46e54-ca72-4986-891b-311bf0473151 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:50.040301 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46e54-ca72-4986-891b-311bf0473151 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:50.040399 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46e54-ca72-4986-891b-311bf0473151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:50.061482 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-9bd46e54-ca72-4986-891b-311bf0473151 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:50.062850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-9bd46e54-ca72-4986-891b-311bf0473151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:50.124238 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1402/2806] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 20:07:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:50.153748 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:50.155460 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:50.239626 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb18a52-d7e8-45d6-952a-873995303109 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:50.245862 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15df5-199d-41fb-a249-cae49363ce66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:50.246611 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15df5-199d-41fb-a249-cae49363ce66 service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:50.246893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15df5-199d-41fb-a249-cae49363ce66 service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:50.247168 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15df5-199d-41fb-a249-cae49363ce66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:50.257022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c15df5-199d-41fb-a249-cae49363ce66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:50.258654 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c15df5-199d-41fb-a249-cae49363ce66 service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:50.266895 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1405/2807] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:07:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:07:50.815753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cba8ce-1364-40ca-a239-651ae9c9b79a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:50.816039 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cba8ce-1364-40ca-a239-651ae9c9b79a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:50.816315 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cba8ce-1364-40ca-a239-651ae9c9b79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:50.835025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a6cba8ce-1364-40ca-a239-651ae9c9b79a None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:50.836423 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a6cba8ce-1364-40ca-a239-651ae9c9b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:50.845662 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1403/2808] 10.222.0.49 () {58 vars in 967 bytes} [Tue Mar 22 20:07:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:50.859991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15df5-199d-41fb-a249-cae49363ce66 service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:50.871486 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15df5-199d-41fb-a249-cae49363ce66 service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:50.877875 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b7de4-c479-4616-bd7a-ac70e0b6a89c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:50.878544 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b7de4-c479-4616-bd7a-ac70e0b6a89c service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:50.878827 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b7de4-c479-4616-bd7a-ac70e0b6a89c service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:50.879099 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b7de4-c479-4616-bd7a-ac70e0b6a89c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:50.887939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b7de4-c479-4616-bd7a-ac70e0b6a89c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:50.889571 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b7de4-c479-4616-bd7a-ac70e0b6a89c service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:50.899167 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1406/2809] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:07:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:07:51.111208 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998e2d-e3a6-426d-8e61-cb3e5b0ebe9a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:51.111697 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998e2d-e3a6-426d-8e61-cb3e5b0ebe9a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:51.111803 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7998e2d-e3a6-426d-8e61-cb3e5b0ebe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:51.131185 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-a7998e2d-e3a6-426d-8e61-cb3e5b0ebe9a None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:51.132521 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-a7998e2d-e3a6-426d-8e61-cb3e5b0ebe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:51.141104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1404/2810] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 20:07:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:51.153385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b7de4-c479-4616-bd7a-ac70e0b6a89c service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:51.164291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b7de4-c479-4616-bd7a-ac70e0b6a89c service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:51.170491 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8187fe-f412-4506-99fe-dac689e78d40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:51.171130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8187fe-f412-4506-99fe-dac689e78d40 service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:51.171417 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8187fe-f412-4506-99fe-dac689e78d40 service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:51.171697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8187fe-f412-4506-99fe-dac689e78d40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:51.180499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8187fe-f412-4506-99fe-dac689e78d40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:51.182152 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8187fe-f412-4506-99fe-dac689e78d40 service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:51.191082 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1407/2811] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:07:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:07:51.548233 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127bb5-be8b-4b42-9dea-7f26288da0fb None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:51.548447 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127bb5-be8b-4b42-9dea-7f26288da0fb None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:51.548736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127bb5-be8b-4b42-9dea-7f26288da0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:51.569789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-cf127bb5-be8b-4b42-9dea-7f26288da0fb None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:51.571152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cf127bb5-be8b-4b42-9dea-7f26288da0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:51.580326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1405/2812] 10.222.0.49 () {58 vars in 967 bytes} [Tue Mar 22 20:07:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:51.594670 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8187fe-f412-4506-99fe-dac689e78d40 service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:51.606782 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8187fe-f412-4506-99fe-dac689e78d40 service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:51.612889 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb69b69-b9de-4d46-8dfd-543be3d0dd3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:51.613526 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb69b69-b9de-4d46-8dfd-543be3d0dd3e service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:51.613815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb69b69-b9de-4d46-8dfd-543be3d0dd3e service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:51.614119 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb69b69-b9de-4d46-8dfd-543be3d0dd3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:51.622735 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb69b69-b9de-4d46-8dfd-543be3d0dd3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:51.624314 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb69b69-b9de-4d46-8dfd-543be3d0dd3e service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:51.632477 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1408/2813] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:07:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:07:54.779734 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127bb5-be8b-4b42-9dea-7f26288da0fb None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:54.781403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cf127bb5-be8b-4b42-9dea-7f26288da0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:54.851027 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127bb5-be8b-4b42-9dea-7f26288da0fb None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:54.856331 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:54.857205 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:54.857505 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:54.857780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] PATH_INFO: `/v3/users/c84e767163684e53aff0986bb70d8b0c` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:54.859059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84e767163684e53aff0986bb70d8b0c)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:54.861022 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:54.921737 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84e767163684e53aff0986bb70d8b0c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:54.935987 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84e767163684e53aff0986bb70d8b0c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:54.946255 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84e767163684e53aff0986bb70d8b0c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:54.947214 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84e767163684e53aff0986bb70d8b0c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:54.955575 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84e767163684e53aff0986bb70d8b0c'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:54.962127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1406/2814] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:07:54 2022] DELETE /identity/v3/users/c84e767163684e53aff0986bb70d8b0c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:54.968555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db81eb-711d-40a0-aa25-7322e026c358 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:54.969055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db81eb-711d-40a0-aa25-7322e026c358 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:54.969055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db81eb-711d-40a0-aa25-7322e026c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:54.989438 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-a7db81eb-711d-40a0-aa25-7322e026c358 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:54.990713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a7db81eb-711d-40a0-aa25-7322e026c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:55.057494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1409/2815] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:55.069860 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:55.071614 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:55.134661 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbafa1-2df4-476b-8d92-2024f5b6aefb admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:55.139136 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5379e50-0bdc-42eb-8885-c317dc6f9478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:55.139780 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5379e50-0bdc-42eb-8885-c317dc6f9478 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.140061 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5379e50-0bdc-42eb-8885-c317dc6f9478 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.140326 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5379e50-0bdc-42eb-8885-c317dc6f9478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.149960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5379e50-0bdc-42eb-8885-c317dc6f9478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:55.151619 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5379e50-0bdc-42eb-8885-c317dc6f9478 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:55.160847 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1407/2816] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:07:55.344384 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db81eb-711d-40a0-aa25-7322e026c358 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:55.346778 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-a7db81eb-711d-40a0-aa25-7322e026c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:55.364718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db81eb-711d-40a0-aa25-7322e026c358 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:55.375662 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:55.376715 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.376981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.377260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] PATH_INFO: `/v3/projects/5fb9130a5732482897b161fa7d2115e5` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.378738 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb9130a5732482897b161fa7d2115e5)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:55.381039 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:55.431672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb9130a5732482897b161fa7d2115e5', 'request_id': 'req-d4fec5cf-033f-4936-a00b-e25f200fcf73'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:55.437134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb9130a5732482897b161fa7d2115e5', 'request_id': 'req-d4fec5cf-033f-4936-a00b-e25f200fcf73'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:55.443278 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb9130a5732482897b161fa7d2115e5', 'request_id': 'req-d4fec5cf-033f-4936-a00b-e25f200fcf73'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:55.457522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] The token cache is being invalidate because project 5fb9130a5732482897b161fa7d2115e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:07:55.457813 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:55.458462 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d4fec5cf-033f-4936-a00b-e25f200fcf73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:07:55.460075 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1410/2817] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:07:55 2022] DELETE /identity/v3/projects/5fb9130a5732482897b161fa7d2115e5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:07:55.465065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbb392-3343-45c7-936d-f930d084794a None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.465485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbb392-3343-45c7-936d-f930d084794a None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.465642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbb392-3343-45c7-936d-f930d084794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.484160 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-25bbb392-3343-45c7-936d-f930d084794a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:55.485355 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-25bbb392-3343-45c7-936d-f930d084794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:55.560740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1408/2818] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:55.569262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2453-5737-4a5a-a0c4-74ea432b6237 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.569624 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2453-5737-4a5a-a0c4-74ea432b6237 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.569901 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2453-5737-4a5a-a0c4-74ea432b6237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.589480 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-ae2c2453-5737-4a5a-a0c4-74ea432b6237 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:55.595908 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ae2c2453-5737-4a5a-a0c4-74ea432b6237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:55.599210 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1411/2819] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:07:55.603931 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbb392-3343-45c7-936d-f930d084794a None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:55.614282 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbb392-3343-45c7-936d-f930d084794a None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:55.618885 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca0d71-8416-45a5-b3be-8adc8852769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:55.619540 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca0d71-8416-45a5-b3be-8adc8852769f admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.619848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca0d71-8416-45a5-b3be-8adc8852769f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.620180 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca0d71-8416-45a5-b3be-8adc8852769f admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.620895 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca0d71-8416-45a5-b3be-8adc8852769f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:07:55.621204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca0d71-8416-45a5-b3be-8adc8852769f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:55.622839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca0d71-8416-45a5-b3be-8adc8852769f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:55.634367 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1409/2820] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:07:55.640111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c2453-5737-4a5a-a0c4-74ea432b6237 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:55.652718 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c2453-5737-4a5a-a0c4-74ea432b6237 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:55.658064 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09d047-3692-494e-ba2f-5c9136a29459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:55.658716 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09d047-3692-494e-ba2f-5c9136a29459 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.658994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09d047-3692-494e-ba2f-5c9136a29459 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.659266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09d047-3692-494e-ba2f-5c9136a29459 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.659955 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09d047-3692-494e-ba2f-5c9136a29459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:55.661859 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09d047-3692-494e-ba2f-5c9136a29459 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:55.689974 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1412/2821] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:07:55 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:07:55.694230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca0d71-8416-45a5-b3be-8adc8852769f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:55.704434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca0d71-8416-45a5-b3be-8adc8852769f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:55.772350 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa09c-fef6-4a0a-8053-48cae4b17d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:55.773013 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa09c-fef6-4a0a-8053-48cae4b17d09 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.773245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa09c-fef6-4a0a-8053-48cae4b17d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.773560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa09c-fef6-4a0a-8053-48cae4b17d09 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.774287 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aa09c-fef6-4a0a-8053-48cae4b17d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:55.777370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aa09c-fef6-4a0a-8053-48cae4b17d09 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:55.799415 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1410/2822] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:07:55 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:07:55.804661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09d047-3692-494e-ba2f-5c9136a29459 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:55.815963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09d047-3692-494e-ba2f-5c9136a29459 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:55.821262 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803bd05-f1ad-4b90-8479-8996f83eeeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:55.822160 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803bd05-f1ad-4b90-8479-8996f83eeeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.822658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803bd05-f1ad-4b90-8479-8996f83eeeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.823159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803bd05-f1ad-4b90-8479-8996f83eeeb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.824501 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803bd05-f1ad-4b90-8479-8996f83eeeb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:55.826408 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803bd05-f1ad-4b90-8479-8996f83eeeb2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:55.841523 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1413/2823] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:55.845591 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa09c-fef6-4a0a-8053-48cae4b17d09 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:55.857519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa09c-fef6-4a0a-8053-48cae4b17d09 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:55.870789 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316e99f-feab-4bcb-a0fc-c4da0c475617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:55.871458 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e99f-feab-4bcb-a0fc-c4da0c475617 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.871730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e99f-feab-4bcb-a0fc-c4da0c475617 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.871998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e99f-feab-4bcb-a0fc-c4da0c475617 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.872719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316e99f-feab-4bcb-a0fc-c4da0c475617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:55.874359 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316e99f-feab-4bcb-a0fc-c4da0c475617 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:55.888408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1411/2824] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:07:55.892733 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803bd05-f1ad-4b90-8479-8996f83eeeb2 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:55.903401 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803bd05-f1ad-4b90-8479-8996f83eeeb2 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:55.908087 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e921c-b7a7-47fe-8d76-747ea534f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:55.908961 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e921c-b7a7-47fe-8d76-747ea534f38e admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.909243 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e921c-b7a7-47fe-8d76-747ea534f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.909515 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e921c-b7a7-47fe-8d76-747ea534f38e admin admin] PATH_INFO: `/v3/projects/02527ad1c9ba40c2805ad2b00ed1760a/users/f6f67da8b4ee4fcf8a407ce27029db68/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.924102 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e921c-b7a7-47fe-8d76-747ea534f38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02527ad1c9ba40c2805ad2b00ed1760a, user_id=f6f67da8b4ee4fcf8a407ce27029db68, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:55.926789 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e921c-b7a7-47fe-8d76-747ea534f38e admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:55.942351 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1414/2825] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:07:55 2022] PUT /identity/v3/projects/02527ad1c9ba40c2805ad2b00ed1760a/users/f6f67da8b4ee4fcf8a407ce27029db68/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:07:55.957781 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9947cb7-e35d-4c4d-9464-1fb42b3f31de None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:55.958211 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9947cb7-e35d-4c4d-9464-1fb42b3f31de None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:55.958553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9947cb7-e35d-4c4d-9464-1fb42b3f31de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:55.989594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-c9947cb7-e35d-4c4d-9464-1fb42b3f31de None None] MFA Rules not processed for user `f6f67da8b4ee4fcf8a407ce27029db68`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:07:55.990797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c9947cb7-e35d-4c4d-9464-1fb42b3f31de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:56.060257 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1412/2826] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:07:56.075141 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e921c-b7a7-47fe-8d76-747ea534f38e admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:07:56.077205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-0f6e921c-b7a7-47fe-8d76-747ea534f38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:07:56.138769 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e921c-b7a7-47fe-8d76-747ea534f38e admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:07:56.143182 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6da383-435f-4fce-8f33-2d629405cd31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:07:56.143820 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6da383-435f-4fce-8f33-2d629405cd31 service cinder] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:07:56.144094 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6da383-435f-4fce-8f33-2d629405cd31 service cinder] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:07:56.144366 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6da383-435f-4fce-8f33-2d629405cd31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:07:56.153643 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6da383-435f-4fce-8f33-2d629405cd31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:07:56.155134 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6da383-435f-4fce-8f33-2d629405cd31 service cinder] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:07:56.163923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1415/2827] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:07:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:08:01.978308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9947cb7-e35d-4c4d-9464-1fb42b3f31de None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:01.980448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c9947cb7-e35d-4c4d-9464-1fb42b3f31de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:02.048893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9947cb7-e35d-4c4d-9464-1fb42b3f31de None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:02.053336 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:02.054321 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:02.054598 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:02.054865 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] PATH_INFO: `/v3/users/73023820d5ca4965b95a05611a7cc62b` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:02.056056 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73023820d5ca4965b95a05611a7cc62b)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:02.058076 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:02.111251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73023820d5ca4965b95a05611a7cc62b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.124501 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73023820d5ca4965b95a05611a7cc62b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.134532 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73023820d5ca4965b95a05611a7cc62b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.135414 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73023820d5ca4965b95a05611a7cc62b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.143644 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73023820d5ca4965b95a05611a7cc62b'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.150344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1413/2828] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:08:01 2022] DELETE /identity/v3/users/73023820d5ca4965b95a05611a7cc62b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:08:02.155187 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552633a5-9eea-4025-b9b3-292726a882a1 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:02.156362 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552633a5-9eea-4025-b9b3-292726a882a1 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:02.156737 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552633a5-9eea-4025-b9b3-292726a882a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:02.174318 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-552633a5-9eea-4025-b9b3-292726a882a1 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:02.175512 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-552633a5-9eea-4025-b9b3-292726a882a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:02.235018 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1416/2829] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:02.245234 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:02.246819 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:02.307515 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca5e54-df23-434c-8fa8-45b9cdc9e496 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:02.313523 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983c60e-51e7-4a80-bd9f-58dda6be2191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:02.314565 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983c60e-51e7-4a80-bd9f-58dda6be2191 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:02.314971 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983c60e-51e7-4a80-bd9f-58dda6be2191 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:02.315369 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983c60e-51e7-4a80-bd9f-58dda6be2191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:02.329025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983c60e-51e7-4a80-bd9f-58dda6be2191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:02.330984 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983c60e-51e7-4a80-bd9f-58dda6be2191 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:02.341455 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1414/2830] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:08:02.637568 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552633a5-9eea-4025-b9b3-292726a882a1 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:02.639055 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-552633a5-9eea-4025-b9b3-292726a882a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:02.652834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552633a5-9eea-4025-b9b3-292726a882a1 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:02.658122 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:02.659216 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:02.659578 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:02.659768 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] PATH_INFO: `/v3/projects/4e9c8f8970a945989180ebec23a58dc3` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:02.661079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9c8f8970a945989180ebec23a58dc3)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:02.663013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:02.711519 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9c8f8970a945989180ebec23a58dc3', 'request_id': 'req-06e8a6e5-d644-4507-b948-335ef3280794'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.717412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9c8f8970a945989180ebec23a58dc3', 'request_id': 'req-06e8a6e5-d644-4507-b948-335ef3280794'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.723513 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9c8f8970a945989180ebec23a58dc3', 'request_id': 'req-06e8a6e5-d644-4507-b948-335ef3280794'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.736743 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] The token cache is being invalidate because project 4e9c8f8970a945989180ebec23a58dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:08:02.737032 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.737676 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-06e8a6e5-d644-4507-b948-335ef3280794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:02.739263 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1417/2831] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:08:02 2022] DELETE /identity/v3/projects/4e9c8f8970a945989180ebec23a58dc3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:08:02.744264 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91cf2-2671-47c0-a3fa-cb65a1753020 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:02.744660 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91cf2-2671-47c0-a3fa-cb65a1753020 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:02.744940 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91cf2-2671-47c0-a3fa-cb65a1753020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:02.763445 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-11e91cf2-2671-47c0-a3fa-cb65a1753020 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:02.764666 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-11e91cf2-2671-47c0-a3fa-cb65a1753020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:02.835776 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1415/2832] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:02.844652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e8ff-6279-48e0-8e72-db473764e23a None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:02.844944 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e8ff-6279-48e0-8e72-db473764e23a None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:02.845225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e8ff-6279-48e0-8e72-db473764e23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:02.864365 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-1129e8ff-6279-48e0-8e72-db473764e23a None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:02.865553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1129e8ff-6279-48e0-8e72-db473764e23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:02.874362 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1418/2833] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:02.878899 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e91cf2-2671-47c0-a3fa-cb65a1753020 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:02.890560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e91cf2-2671-47c0-a3fa-cb65a1753020 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:02.895875 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b7edc-080e-4b40-bc01-40a6fee69f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:02.896533 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b7edc-080e-4b40-bc01-40a6fee69f06 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:02.896817 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b7edc-080e-4b40-bc01-40a6fee69f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:02.897091 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b7edc-080e-4b40-bc01-40a6fee69f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:02.897843 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b7edc-080e-4b40-bc01-40a6fee69f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:08:02.898182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b7edc-080e-4b40-bc01-40a6fee69f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:02.899787 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b7edc-080e-4b40-bc01-40a6fee69f06 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:02.912576 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1416/2834] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 22 20:08:02.917283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e8ff-6279-48e0-8e72-db473764e23a None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:02.926529 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e8ff-6279-48e0-8e72-db473764e23a None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:02.931678 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecec95-bf84-44ad-95c6-be81ad9c3b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:02.932553 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecec95-bf84-44ad-95c6-be81ad9c3b90 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:02.932712 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecec95-bf84-44ad-95c6-be81ad9c3b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:02.932981 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecec95-bf84-44ad-95c6-be81ad9c3b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:02.933672 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecec95-bf84-44ad-95c6-be81ad9c3b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:02.935615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecec95-bf84-44ad-95c6-be81ad9c3b90 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:02.968831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1419/2835] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:08:02 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:08:02.975161 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b7edc-080e-4b40-bc01-40a6fee69f06 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:02.992134 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b7edc-080e-4b40-bc01-40a6fee69f06 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:03.049851 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4c364-2236-419a-9002-24eefa1be7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:03.050563 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4c364-2236-419a-9002-24eefa1be7ff admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:03.050845 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4c364-2236-419a-9002-24eefa1be7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:03.051122 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4c364-2236-419a-9002-24eefa1be7ff admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:03.051809 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4c364-2236-419a-9002-24eefa1be7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:03.053741 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4c364-2236-419a-9002-24eefa1be7ff admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:03.074451 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1417/2836] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:08:02 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:08:03.078695 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecec95-bf84-44ad-95c6-be81ad9c3b90 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:03.089530 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecec95-bf84-44ad-95c6-be81ad9c3b90 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:03.095596 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb397b-c6b0-4e5d-bfa3-470998b57129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:03.096266 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb397b-c6b0-4e5d-bfa3-470998b57129 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:03.096550 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb397b-c6b0-4e5d-bfa3-470998b57129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:03.096838 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb397b-c6b0-4e5d-bfa3-470998b57129 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:03.097555 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb397b-c6b0-4e5d-bfa3-470998b57129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:03.099208 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb397b-c6b0-4e5d-bfa3-470998b57129 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:03.110489 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1420/2837] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:08:03.116362 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4c364-2236-419a-9002-24eefa1be7ff admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:03.131192 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4c364-2236-419a-9002-24eefa1be7ff admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:03.137631 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0cb2e-48f4-49e0-b9ef-2524306c0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:03.138324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0cb2e-48f4-49e0-b9ef-2524306c0231 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:03.138607 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0cb2e-48f4-49e0-b9ef-2524306c0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:03.138883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0cb2e-48f4-49e0-b9ef-2524306c0231 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:03.139608 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0cb2e-48f4-49e0-b9ef-2524306c0231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:03.141273 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0cb2e-48f4-49e0-b9ef-2524306c0231 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:03.151733 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1418/2838] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:08:03.156026 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb397b-c6b0-4e5d-bfa3-470998b57129 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:03.167086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb397b-c6b0-4e5d-bfa3-470998b57129 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:03.172114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067adc3-7ba6-4acd-9141-e24992a23b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:03.173032 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067adc3-7ba6-4acd-9141-e24992a23b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:03.173304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067adc3-7ba6-4acd-9141-e24992a23b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:03.173576 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067adc3-7ba6-4acd-9141-e24992a23b25 admin admin] PATH_INFO: `/v3/projects/981b744fb5294e24a8c969e3acb11217/users/42e820c5035149569828245030ee161f/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:03.189538 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067adc3-7ba6-4acd-9141-e24992a23b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981b744fb5294e24a8c969e3acb11217, user_id=42e820c5035149569828245030ee161f, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:03.192709 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067adc3-7ba6-4acd-9141-e24992a23b25 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:03.207076 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1421/2839] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:08:03 2022] PUT /identity/v3/projects/981b744fb5294e24a8c969e3acb11217/users/42e820c5035149569828245030ee161f/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:08:03.212288 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8353-1652-47f9-9273-aa509b94746d None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:03.212578 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8353-1652-47f9-9273-aa509b94746d None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:03.212856 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d8353-1652-47f9-9273-aa509b94746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:03.231735 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-149d8353-1652-47f9-9273-aa509b94746d None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:03.232930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-149d8353-1652-47f9-9273-aa509b94746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:03.302090 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1419/2840] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:03.312225 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067adc3-7ba6-4acd-9141-e24992a23b25 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:03.314058 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-6067adc3-7ba6-4acd-9141-e24992a23b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:03.387566 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067adc3-7ba6-4acd-9141-e24992a23b25 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:03.392015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fc04f-2113-4e7f-ba5a-a80dc155e0ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:03.393918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fc04f-2113-4e7f-ba5a-a80dc155e0ca service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:03.393918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fc04f-2113-4e7f-ba5a-a80dc155e0ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:03.393918 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fc04f-2113-4e7f-ba5a-a80dc155e0ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:03.403522 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fc04f-2113-4e7f-ba5a-a80dc155e0ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:03.405202 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fc04f-2113-4e7f-ba5a-a80dc155e0ca service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:03.415597 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1422/2841] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:08:04.438784 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d8353-1652-47f9-9273-aa509b94746d None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:04.440261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-149d8353-1652-47f9-9273-aa509b94746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:04.452152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d8353-1652-47f9-9273-aa509b94746d None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:04.457492 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:04.458414 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:04.458679 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:04.459152 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] PATH_INFO: `/v3/users/f6f67da8b4ee4fcf8a407ce27029db68` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:04.460403 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f67da8b4ee4fcf8a407ce27029db68)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:04.462396 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:04.520164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f67da8b4ee4fcf8a407ce27029db68'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:04.536652 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f67da8b4ee4fcf8a407ce27029db68'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:04.545137 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f67da8b4ee4fcf8a407ce27029db68'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:04.545756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f67da8b4ee4fcf8a407ce27029db68'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:04.553026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f67da8b4ee4fcf8a407ce27029db68'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:04.559182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1420/2842] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:08:04 2022] DELETE /identity/v3/users/f6f67da8b4ee4fcf8a407ce27029db68 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:08:04.563933 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab9d64-963c-4c9b-90f2-3c765496d2c6 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:04.564440 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab9d64-963c-4c9b-90f2-3c765496d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:04.564635 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab9d64-963c-4c9b-90f2-3c765496d2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:04.582628 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-37ab9d64-963c-4c9b-90f2-3c765496d2c6 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:04.583939 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-37ab9d64-963c-4c9b-90f2-3c765496d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:04.647730 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1423/2843] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:04.658183 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:04.659715 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:04.725395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc44532-f59c-45ee-9a55-016d438cf2ae admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:04.729349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01911ec4-3bb7-4b28-b24e-378cacaf105c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:04.730143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911ec4-3bb7-4b28-b24e-378cacaf105c service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:04.730499 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911ec4-3bb7-4b28-b24e-378cacaf105c service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:04.730839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911ec4-3bb7-4b28-b24e-378cacaf105c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:04.740832 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01911ec4-3bb7-4b28-b24e-378cacaf105c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:04.742529 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01911ec4-3bb7-4b28-b24e-378cacaf105c service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:04.753496 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1421/2844] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:08:05.101040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab9d64-963c-4c9b-90f2-3c765496d2c6 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:05.103200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-37ab9d64-963c-4c9b-90f2-3c765496d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:05.117847 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab9d64-963c-4c9b-90f2-3c765496d2c6 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:05.123253 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:05.124067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.124346 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.124755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] PATH_INFO: `/v3/projects/02527ad1c9ba40c2805ad2b00ed1760a` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.126181 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=02527ad1c9ba40c2805ad2b00ed1760a)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:05.128259 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:05.176013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02527ad1c9ba40c2805ad2b00ed1760a', 'request_id': 'req-477d30f8-450d-42bd-b89e-25a8e109e9cd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:05.181303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02527ad1c9ba40c2805ad2b00ed1760a', 'request_id': 'req-477d30f8-450d-42bd-b89e-25a8e109e9cd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:05.188086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02527ad1c9ba40c2805ad2b00ed1760a', 'request_id': 'req-477d30f8-450d-42bd-b89e-25a8e109e9cd'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:05.203286 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] The token cache is being invalidate because project 02527ad1c9ba40c2805ad2b00ed1760a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:08:05.204109 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:05.204697 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-477d30f8-450d-42bd-b89e-25a8e109e9cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:08:05.208296 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1424/2845] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:08:05 2022] DELETE /identity/v3/projects/02527ad1c9ba40c2805ad2b00ed1760a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:08:05.213279 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d74529-5249-403b-b4e5-159205890410 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.213561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d74529-5249-403b-b4e5-159205890410 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.213833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d74529-5249-403b-b4e5-159205890410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.233736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-09d74529-5249-403b-b4e5-159205890410 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:05.234986 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-09d74529-5249-403b-b4e5-159205890410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:05.297404 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1422/2846] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:05.305428 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dedbf3-8f2c-4b54-8354-86a5c8aeb7f4 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.305713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dedbf3-8f2c-4b54-8354-86a5c8aeb7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.306024 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dedbf3-8f2c-4b54-8354-86a5c8aeb7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.326117 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-77dedbf3-8f2c-4b54-8354-86a5c8aeb7f4 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:05.327328 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-77dedbf3-8f2c-4b54-8354-86a5c8aeb7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:05.335616 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1425/2847] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:08:05.340710 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d74529-5249-403b-b4e5-159205890410 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:05.350849 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d74529-5249-403b-b4e5-159205890410 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:05.356108 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbb407-4628-4789-bdc9-ad0dcd1382da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:05.356934 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbb407-4628-4789-bdc9-ad0dcd1382da admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.357332 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbb407-4628-4789-bdc9-ad0dcd1382da admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.357610 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbb407-4628-4789-bdc9-ad0dcd1382da admin admin] PATH_INFO: `/v3/domains` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.358380 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbb407-4628-4789-bdc9-ad0dcd1382da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 22 20:08:05.358688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbb407-4628-4789-bdc9-ad0dcd1382da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:05.360824 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbb407-4628-4789-bdc9-ad0dcd1382da admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:05.373536 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1423/2848] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Mar 22 20:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 22 20:08:05.378176 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dedbf3-8f2c-4b54-8354-86a5c8aeb7f4 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:05.389590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dedbf3-8f2c-4b54-8354-86a5c8aeb7f4 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:05.394452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c77eb-b764-4241-bf07-a4fbfb5c3307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:05.395125 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c77eb-b764-4241-bf07-a4fbfb5c3307 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.395412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c77eb-b764-4241-bf07-a4fbfb5c3307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.395729 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c77eb-b764-4241-bf07-a4fbfb5c3307 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.396444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c77eb-b764-4241-bf07-a4fbfb5c3307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:05.398403 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c77eb-b764-4241-bf07-a4fbfb5c3307 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:05.429128 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1426/2849] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:08:05 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:08:05.430450 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbb407-4628-4789-bdc9-ad0dcd1382da admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:05.440881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbb407-4628-4789-bdc9-ad0dcd1382da admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:05.506960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b341ae0-eb98-4016-b4cc-9db4acd635bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:05.507645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b341ae0-eb98-4016-b4cc-9db4acd635bd admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.507927 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b341ae0-eb98-4016-b4cc-9db4acd635bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.508202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b341ae0-eb98-4016-b4cc-9db4acd635bd admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.508893 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b341ae0-eb98-4016-b4cc-9db4acd635bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:05.511025 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b341ae0-eb98-4016-b4cc-9db4acd635bd admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:05.533876 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1424/2850] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:08:05 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:08:05.538466 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c77eb-b764-4241-bf07-a4fbfb5c3307 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:05.549854 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c77eb-b764-4241-bf07-a4fbfb5c3307 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:05.555142 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864157-c90f-4723-8ce1-bb661627c7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:05.555923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864157-c90f-4723-8ce1-bb661627c7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.556272 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864157-c90f-4723-8ce1-bb661627c7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.556610 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2864157-c90f-4723-8ce1-bb661627c7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.557561 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2864157-c90f-4723-8ce1-bb661627c7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:05.559479 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2864157-c90f-4723-8ce1-bb661627c7d0 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:05.571204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1427/2851] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:08:05.575594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b341ae0-eb98-4016-b4cc-9db4acd635bd admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:05.586178 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b341ae0-eb98-4016-b4cc-9db4acd635bd admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:05.592327 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309d014-f60f-4269-a094-37e333d2c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:05.593144 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309d014-f60f-4269-a094-37e333d2c9ce admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.593518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309d014-f60f-4269-a094-37e333d2c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.593890 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309d014-f60f-4269-a094-37e333d2c9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.594754 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309d014-f60f-4269-a094-37e333d2c9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:05.596477 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309d014-f60f-4269-a094-37e333d2c9ce admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:05.611102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1425/2852] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:08:05.612538 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864157-c90f-4723-8ce1-bb661627c7d0 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:05.624069 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2864157-c90f-4723-8ce1-bb661627c7d0 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:05.629677 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae869cd1-2cda-4a30-af47-3e8e1313ce76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:05.630987 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae869cd1-2cda-4a30-af47-3e8e1313ce76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.631493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae869cd1-2cda-4a30-af47-3e8e1313ce76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.631770 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae869cd1-2cda-4a30-af47-3e8e1313ce76 admin admin] PATH_INFO: `/v3/projects/76cde34ed04f4d4297839f0229dd5c25/users/c4d36290bff7438da07f683c06ea8981/roles/a50cc38d78674f6eaffc44a0a26ed453` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.656380 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae869cd1-2cda-4a30-af47-3e8e1313ce76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76cde34ed04f4d4297839f0229dd5c25, user_id=c4d36290bff7438da07f683c06ea8981, role_id=a50cc38d78674f6eaffc44a0a26ed453)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:05.659323 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae869cd1-2cda-4a30-af47-3e8e1313ce76 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:05.693281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1428/2853] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:08:05 2022] PUT /identity/v3/projects/76cde34ed04f4d4297839f0229dd5c25/users/c4d36290bff7438da07f683c06ea8981/roles/a50cc38d78674f6eaffc44a0a26ed453 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:08:05.694848 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b83720-412e-46be-a8cf-7a23760e9a80 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.695141 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b83720-412e-46be-a8cf-7a23760e9a80 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.695425 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b83720-412e-46be-a8cf-7a23760e9a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.720122 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-06b83720-412e-46be-a8cf-7a23760e9a80 None None] MFA Rules not processed for user `686bfe5266224121af654efbb4f624b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:05.721759 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-06b83720-412e-46be-a8cf-7a23760e9a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:05.787132 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1426/2854] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:05.798275 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae869cd1-2cda-4a30-af47-3e8e1313ce76 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:05.800694 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ae869cd1-2cda-4a30-af47-3e8e1313ce76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:05.882621 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae869cd1-2cda-4a30-af47-3e8e1313ce76 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:05.888015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8221d3-3176-48b7-bc75-fa698f162730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:05.889831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8221d3-3176-48b7-bc75-fa698f162730 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:05.890319 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8221d3-3176-48b7-bc75-fa698f162730 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:05.890604 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8221d3-3176-48b7-bc75-fa698f162730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:05.905004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8221d3-3176-48b7-bc75-fa698f162730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:05.907726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8221d3-3176-48b7-bc75-fa698f162730 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:05.923584 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1429/2855] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:08:07.872080 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442d85-c57f-4d11-8d96-96db1a06ee38 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:07.872590 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442d85-c57f-4d11-8d96-96db1a06ee38 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:07.872674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442d85-c57f-4d11-8d96-96db1a06ee38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:07.908650 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-33442d85-c57f-4d11-8d96-96db1a06ee38 None None] MFA Rules not processed for user `42e820c5035149569828245030ee161f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:07.910463 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-33442d85-c57f-4d11-8d96-96db1a06ee38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:07.993783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1427/2856] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:08:07.995267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8221d3-3176-48b7-bc75-fa698f162730 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:07.996865 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3b8221d3-3176-48b7-bc75-fa698f162730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:08.012574 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8221d3-3176-48b7-bc75-fa698f162730 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:08.019969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2e056-2941-44f0-be8d-e789f9034360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:08.020646 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2e056-2941-44f0-be8d-e789f9034360 admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:08.020928 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2e056-2941-44f0-be8d-e789f9034360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:08.021200 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2e056-2941-44f0-be8d-e789f9034360 admin admin] PATH_INFO: `/v3/projects` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:08.021914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2e056-2941-44f0-be8d-e789f9034360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:08.023831 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2e056-2941-44f0-be8d-e789f9034360 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:08.053978 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1430/2857] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:08:07 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:08:08.057813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33442d85-c57f-4d11-8d96-96db1a06ee38 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:08.068852 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33442d85-c57f-4d11-8d96-96db1a06ee38 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:08.137065 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b60c3-8241-4f65-92a7-df44e4d96265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:08.138434 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b60c3-8241-4f65-92a7-df44e4d96265 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:08.139124 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b60c3-8241-4f65-92a7-df44e4d96265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:08.139688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b60c3-8241-4f65-92a7-df44e4d96265 admin admin] PATH_INFO: `/v3/users` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:08.140743 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b60c3-8241-4f65-92a7-df44e4d96265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:08.143232 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b60c3-8241-4f65-92a7-df44e4d96265 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:08.169251 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1428/2858] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:08:08 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 22 20:08:08.173015 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2e056-2941-44f0-be8d-e789f9034360 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:08.185641 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2e056-2941-44f0-be8d-e789f9034360 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:08.193455 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0437e-5956-4fe5-8e38-c71b33912aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:08.194940 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0437e-5956-4fe5-8e38-c71b33912aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:08.195330 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0437e-5956-4fe5-8e38-c71b33912aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:08.195733 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0437e-5956-4fe5-8e38-c71b33912aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:08.196642 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0437e-5956-4fe5-8e38-c71b33912aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:08.199669 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0437e-5956-4fe5-8e38-c71b33912aa9 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:08.218114 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1431/2859] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:08:08.221900 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b60c3-8241-4f65-92a7-df44e4d96265 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:08.232402 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b60c3-8241-4f65-92a7-df44e4d96265 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:08.237304 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbec31-6df1-4743-b171-d749c27d2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:08.238384 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbec31-6df1-4743-b171-d749c27d2ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:08.238791 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbec31-6df1-4743-b171-d749c27d2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:08.239146 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbec31-6df1-4743-b171-d749c27d2ac1 admin admin] PATH_INFO: `/v3/projects/a51efb424b634b74a38a98df36c66072/users/5d7c1bd492a641ac801aa29e5c6e1b00/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:08.255497 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbec31-6df1-4743-b171-d749c27d2ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51efb424b634b74a38a98df36c66072, user_id=5d7c1bd492a641ac801aa29e5c6e1b00, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:08.258313 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbec31-6df1-4743-b171-d749c27d2ac1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:08.272236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1429/2860] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:08:08 2022] PUT /identity/v3/projects/a51efb424b634b74a38a98df36c66072/users/5d7c1bd492a641ac801aa29e5c6e1b00/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:08:08.276385 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0437e-5956-4fe5-8e38-c71b33912aa9 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:08.287830 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0437e-5956-4fe5-8e38-c71b33912aa9 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:08.367440 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10be384-d236-47f4-a176-aa6ca63bb6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:08.368413 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be384-d236-47f4-a176-aa6ca63bb6ac admin admin] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:08.368837 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be384-d236-47f4-a176-aa6ca63bb6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:08.371664 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be384-d236-47f4-a176-aa6ca63bb6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:08.372698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10be384-d236-47f4-a176-aa6ca63bb6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:08.374508 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10be384-d236-47f4-a176-aa6ca63bb6ac admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:08.393765 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1432/2861] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:08:08.399272 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbec31-6df1-4743-b171-d749c27d2ac1 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:08.411156 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbec31-6df1-4743-b171-d749c27d2ac1 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:08.416490 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7551016-1a42-473f-93ab-17752cfe785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:08.417169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551016-1a42-473f-93ab-17752cfe785f admin admin] REQUEST_METHOD: `PUT` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:08.417696 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551016-1a42-473f-93ab-17752cfe785f admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:08.418420 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7551016-1a42-473f-93ab-17752cfe785f admin admin] PATH_INFO: `/v3/projects/a51efb424b634b74a38a98df36c66072/users/5d7c1bd492a641ac801aa29e5c6e1b00/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:08.420395 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7551016-1a42-473f-93ab-17752cfe785f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51efb424b634b74a38a98df36c66072, user_id=5d7c1bd492a641ac801aa29e5c6e1b00, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:08.424169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7551016-1a42-473f-93ab-17752cfe785f admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:08.437249 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1430/2862] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:08:08 2022] PUT /identity/v3/projects/a51efb424b634b74a38a98df36c66072/users/5d7c1bd492a641ac801aa29e5c6e1b00/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 22 20:08:11.670101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c5eb-0907-421d-8f25-8df0170eef77 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:11.671059 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c5eb-0907-421d-8f25-8df0170eef77 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:11.671498 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c5eb-0907-421d-8f25-8df0170eef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:11.725808 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-da57c5eb-0907-421d-8f25-8df0170eef77 None None] MFA Rules not processed for user `c4d36290bff7438da07f683c06ea8981`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:11.729923 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-da57c5eb-0907-421d-8f25-8df0170eef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:11.884713 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1433/2863] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:11.888981 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7551016-1a42-473f-93ab-17752cfe785f admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:12.009318 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7551016-1a42-473f-93ab-17752cfe785f admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:12.016648 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444729d5-5308-4f80-9eae-e8d3edbd4bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:12.017602 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444729d5-5308-4f80-9eae-e8d3edbd4bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:12.018759 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444729d5-5308-4f80-9eae-e8d3edbd4bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:12.019217 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444729d5-5308-4f80-9eae-e8d3edbd4bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:12.020556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444729d5-5308-4f80-9eae-e8d3edbd4bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:12.023053 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444729d5-5308-4f80-9eae-e8d3edbd4bd9 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:12.066431 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1431/2864] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Mar 22 20:08:11 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:08:12.071144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c5eb-0907-421d-8f25-8df0170eef77 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:12.086848 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c5eb-0907-421d-8f25-8df0170eef77 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:12.163123 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada917a-96d8-4a39-8386-d5a2d3e6e55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:12.163905 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada917a-96d8-4a39-8386-d5a2d3e6e55c admin admin] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:12.164248 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada917a-96d8-4a39-8386-d5a2d3e6e55c admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:12.164652 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada917a-96d8-4a39-8386-d5a2d3e6e55c admin admin] PATH_INFO: `/v3/users` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:12.165414 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada917a-96d8-4a39-8386-d5a2d3e6e55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:12.168306 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada917a-96d8-4a39-8386-d5a2d3e6e55c admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:12.194204 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1434/2865] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Mar 22 20:08:12 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 22 20:08:12.198918 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444729d5-5308-4f80-9eae-e8d3edbd4bd9 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:12.210883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444729d5-5308-4f80-9eae-e8d3edbd4bd9 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:12.219370 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce695112-d8ba-43c5-9d96-42c746aa3909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:12.221145 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce695112-d8ba-43c5-9d96-42c746aa3909 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:12.221752 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce695112-d8ba-43c5-9d96-42c746aa3909 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:12.222250 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce695112-d8ba-43c5-9d96-42c746aa3909 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:12.223512 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce695112-d8ba-43c5-9d96-42c746aa3909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:12.226353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce695112-d8ba-43c5-9d96-42c746aa3909 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:12.240018 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1432/2866] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 22 20:08:12.243793 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada917a-96d8-4a39-8386-d5a2d3e6e55c admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:12.258423 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada917a-96d8-4a39-8386-d5a2d3e6e55c admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:12.269755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36e9c3-1f3a-485a-8e3c-8d8ca773d8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:12.270702 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e9c3-1f3a-485a-8e3c-8d8ca773d8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:12.270956 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e9c3-1f3a-485a-8e3c-8d8ca773d8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:12.271226 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36e9c3-1f3a-485a-8e3c-8d8ca773d8cc admin admin] PATH_INFO: `/v3/projects/c82636e247354f5081b8fe14e0328fd6/users/b3bcda9f3eea46edafd02558b7d16bfb/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:12.292895 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36e9c3-1f3a-485a-8e3c-8d8ca773d8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82636e247354f5081b8fe14e0328fd6, user_id=b3bcda9f3eea46edafd02558b7d16bfb, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:12.295786 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36e9c3-1f3a-485a-8e3c-8d8ca773d8cc admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:12.328174 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1435/2867] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:08:12 2022] PUT /identity/v3/projects/c82636e247354f5081b8fe14e0328fd6/users/b3bcda9f3eea46edafd02558b7d16bfb/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:08:12.332408 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce695112-d8ba-43c5-9d96-42c746aa3909 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:12.343833 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce695112-d8ba-43c5-9d96-42c746aa3909 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:12.417567 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba6c8b-e991-4562-acad-6b6762d5c671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:12.420292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba6c8b-e991-4562-acad-6b6762d5c671 admin admin] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:12.420292 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba6c8b-e991-4562-acad-6b6762d5c671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:12.420919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba6c8b-e991-4562-acad-6b6762d5c671 admin admin] PATH_INFO: `/v3/roles` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:12.423227 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba6c8b-e991-4562-acad-6b6762d5c671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:12.434277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba6c8b-e991-4562-acad-6b6762d5c671 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:12.451772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1433/2868] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Mar 22 20:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 22 20:08:12.453224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36e9c3-1f3a-485a-8e3c-8d8ca773d8cc admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:12.465604 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36e9c3-1f3a-485a-8e3c-8d8ca773d8cc admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:12.471287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb9f2c-b772-4613-a0b6-a64f4528779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:12.472742 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9f2c-b772-4613-a0b6-a64f4528779f admin admin] REQUEST_METHOD: `PUT` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:12.473169 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9f2c-b772-4613-a0b6-a64f4528779f admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:12.473592 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9f2c-b772-4613-a0b6-a64f4528779f admin admin] PATH_INFO: `/v3/projects/c82636e247354f5081b8fe14e0328fd6/users/b3bcda9f3eea46edafd02558b7d16bfb/roles/e19a3260f1b64f78a8de1f8d6a6a8988` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:12.476484 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb9f2c-b772-4613-a0b6-a64f4528779f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82636e247354f5081b8fe14e0328fd6, user_id=b3bcda9f3eea46edafd02558b7d16bfb, role_id=e19a3260f1b64f78a8de1f8d6a6a8988)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:12.485473 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb9f2c-b772-4613-a0b6-a64f4528779f admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:12.505411 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1436/2869] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Mar 22 20:08:12 2022] PUT /identity/v3/projects/c82636e247354f5081b8fe14e0328fd6/users/b3bcda9f3eea46edafd02558b7d16bfb/roles/e19a3260f1b64f78a8de1f8d6a6a8988 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:08:14.404348 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c17d-7ed1-4646-b7ed-e8c2367d8ff4 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:14.404960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c17d-7ed1-4646-b7ed-e8c2367d8ff4 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:14.404960 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c17d-7ed1-4646-b7ed-e8c2367d8ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:14.441503 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-5e59c17d-7ed1-4646-b7ed-e8c2367d8ff4 None None] MFA Rules not processed for user `5d7c1bd492a641ac801aa29e5c6e1b00`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:14.450109 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5e59c17d-7ed1-4646-b7ed-e8c2367d8ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:14.599919 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1434/2870] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:14.607194 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb9f2c-b772-4613-a0b6-a64f4528779f admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:14.608914 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-efcb9f2c-b772-4613-a0b6-a64f4528779f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:14.701706 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb9f2c-b772-4613-a0b6-a64f4528779f admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:14.708436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bdc4-5eac-45d3-a3e5-32f786845f08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02aff559435a445db07636197a534f4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:14.709449 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bdc4-5eac-45d3-a3e5-32f786845f08 service glance] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:14.709881 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bdc4-5eac-45d3-a3e5-32f786845f08 service glance] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:14.710436 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548bdc4-5eac-45d3-a3e5-32f786845f08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:14.867148 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548bdc4-5eac-45d3-a3e5-32f786845f08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:14.869931 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548bdc4-5eac-45d3-a3e5-32f786845f08 service glance] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:14.891298 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1437/2871] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:08:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:08:15.084392 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0a42-30c5-4953-923a-2663a8cc5bb1 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:15.085066 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0a42-30c5-4953-923a-2663a8cc5bb1 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:15.085600 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0a42-30c5-4953-923a-2663a8cc5bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:15.110964 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-84cd0a42-30c5-4953-923a-2663a8cc5bb1 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:15.112720 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-84cd0a42-30c5-4953-923a-2663a8cc5bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:15.193645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1435/2872] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 20:08:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:15.207412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bdc4-5eac-45d3-a3e5-32f786845f08 service glance] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:15.210003 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-8548bdc4-5eac-45d3-a3e5-32f786845f08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:15.326089 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548bdc4-5eac-45d3-a3e5-32f786845f08 service glance] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:15.332618 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3da782-2b4b-4bf9-936f-59087c7c184e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:15.333591 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3da782-2b4b-4bf9-936f-59087c7c184e service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:15.334130 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3da782-2b4b-4bf9-936f-59087c7c184e service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:15.334492 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3da782-2b4b-4bf9-936f-59087c7c184e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:15.344025 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3da782-2b4b-4bf9-936f-59087c7c184e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:15.345686 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3da782-2b4b-4bf9-936f-59087c7c184e service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:15.365224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1438/2873] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:08:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:08:19.791594 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0d425-7a06-420e-9e8c-9036a2863ba1 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:19.792962 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0d425-7a06-420e-9e8c-9036a2863ba1 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:19.794008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0d425-7a06-420e-9e8c-9036a2863ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:19.848663 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-5ab0d425-7a06-420e-9e8c-9036a2863ba1 None None] MFA Rules not processed for user `b3bcda9f3eea46edafd02558b7d16bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:19.850740 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5ab0d425-7a06-420e-9e8c-9036a2863ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:20.005907 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1436/2874] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:20.018499 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3da782-2b4b-4bf9-936f-59087c7c184e service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:20.020402 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ca3da782-2b4b-4bf9-936f-59087c7c184e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:20.210310 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3da782-2b4b-4bf9-936f-59087c7c184e service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:20.229727 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d64b3f-5fe2-4707-a949-8b401e41c882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:20.230439 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d64b3f-5fe2-4707-a949-8b401e41c882 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:20.230720 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d64b3f-5fe2-4707-a949-8b401e41c882 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:20.231022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d64b3f-5fe2-4707-a949-8b401e41c882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:20.370590 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d64b3f-5fe2-4707-a949-8b401e41c882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:20.372502 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d64b3f-5fe2-4707-a949-8b401e41c882 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:20.393287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1439/2875] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:08:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:08:29.232675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d25a6-0386-4654-a5d8-ec663db20fcc None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:29.233435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d25a6-0386-4654-a5d8-ec663db20fcc None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:29.233435 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d25a6-0386-4654-a5d8-ec663db20fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:29.255058 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-580d25a6-0386-4654-a5d8-ec663db20fcc None None] MFA Rules not processed for user `42e820c5035149569828245030ee161f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:29.256261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-580d25a6-0386-4654-a5d8-ec663db20fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:29.264236 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1437/2876] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:31.152857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68ee4-0605-41d3-bb8a-c4e591072b75 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:31.153456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68ee4-0605-41d3-bb8a-c4e591072b75 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:31.153456 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68ee4-0605-41d3-bb8a-c4e591072b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:31.172870 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-4fe68ee4-0605-41d3-bb8a-c4e591072b75 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:31.174418 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4fe68ee4-0605-41d3-bb8a-c4e591072b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:31.185111 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1440/2877] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Mar 22 20:08:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 22 20:08:31.198357 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d25a6-0386-4654-a5d8-ec663db20fcc None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:31.211016 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d25a6-0386-4654-a5d8-ec663db20fcc None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:31.217310 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3244-4cf3-4f4a-994e-580fbda6524e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:31.218104 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3244-4cf3-4f4a-994e-580fbda6524e service swift] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:31.218783 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3244-4cf3-4f4a-994e-580fbda6524e service swift] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:31.219159 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3244-4cf3-4f4a-994e-580fbda6524e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:31.228230 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b3244-4cf3-4f4a-994e-580fbda6524e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:31.230120 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b3244-4cf3-4f4a-994e-580fbda6524e service swift] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:31.238572 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1438/2878] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:08:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:08:47.355295 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924e93-4e49-411e-a0c7-edc0f23c4d69 None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:47.355995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924e93-4e49-411e-a0c7-edc0f23c4d69 None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:47.355995 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924e93-4e49-411e-a0c7-edc0f23c4d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:47.375041 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-2e924e93-4e49-411e-a0c7-edc0f23c4d69 None None] MFA Rules not processed for user `c4d36290bff7438da07f683c06ea8981`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:08:47.376422 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-2e924e93-4e49-411e-a0c7-edc0f23c4d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:47.385963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1441/2879] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:08:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:08:47.732691 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3244-4cf3-4f4a-994e-580fbda6524e service swift] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:47.799928 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3244-4cf3-4f4a-994e-580fbda6524e service swift] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:47.803822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:47.804462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:47.804769 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:47.805048 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:47.807224 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:47.816658 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:47.818120 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:47.825915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1439/2880] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:08:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:08:52.482821 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924e93-4e49-411e-a0c7-edc0f23c4d69 None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:52.495067 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924e93-4e49-411e-a0c7-edc0f23c4d69 None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:52.501313 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf7528-1d70-42b6-8215-c14205d48be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:52.502273 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf7528-1d70-42b6-8215-c14205d48be2 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:52.502597 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf7528-1d70-42b6-8215-c14205d48be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:52.502864 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf7528-1d70-42b6-8215-c14205d48be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:52.505494 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f3bf7528-1d70-42b6-8215-c14205d48be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:52.541605 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf7528-1d70-42b6-8215-c14205d48be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:52.543066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf7528-1d70-42b6-8215-c14205d48be2 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:52.565013 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1442/2881] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:08:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:08:54.018753 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:08:54.020424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:54.031730 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647a4a9-9794-4242-9ee3-69160ed05b54 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:08:54.035868 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd589cb-6879-4914-917e-3e03f267fbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:08:54.036518 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd589cb-6879-4914-917e-3e03f267fbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:08:54.036797 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd589cb-6879-4914-917e-3e03f267fbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:08:54.037072 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd589cb-6879-4914-917e-3e03f267fbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:08:54.039005 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-6cd589cb-6879-4914-917e-3e03f267fbf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:08:54.053850 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd589cb-6879-4914-917e-3e03f267fbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:08:54.055344 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd589cb-6879-4914-917e-3e03f267fbf9 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:08:54.067169 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1440/2882] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:08:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:09:04.016988 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf7528-1d70-42b6-8215-c14205d48be2 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:09:04.027893 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf7528-1d70-42b6-8215-c14205d48be2 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:09:04.031983 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac18c4-339e-42a3-8c3e-ae7091851941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:09:04.032690 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac18c4-339e-42a3-8c3e-ae7091851941 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:09:04.032980 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac18c4-339e-42a3-8c3e-ae7091851941 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:09:04.033267 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac18c4-339e-42a3-8c3e-ae7091851941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:09:04.044452 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac18c4-339e-42a3-8c3e-ae7091851941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:09:04.045969 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac18c4-339e-42a3-8c3e-ae7091851941 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:09:04.055787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1443/2883] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:09:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:09:04.099756 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd589cb-6879-4914-917e-3e03f267fbf9 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:09:04.109341 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd589cb-6879-4914-917e-3e03f267fbf9 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:09:04.113267 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf9db7-2067-4a8e-b224-33989dacd026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:09:04.113921 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf9db7-2067-4a8e-b224-33989dacd026 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:09:04.114240 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf9db7-2067-4a8e-b224-33989dacd026 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:09:04.114519 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf9db7-2067-4a8e-b224-33989dacd026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:09:04.124623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf9db7-2067-4a8e-b224-33989dacd026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:09:04.126130 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf9db7-2067-4a8e-b224-33989dacd026 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:09:04.137220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1441/2884] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:09:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:09:06.117433 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac18c4-339e-42a3-8c3e-ae7091851941 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:09:06.120412 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-b0ac18c4-339e-42a3-8c3e-ae7091851941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:09:06.163575 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac18c4-339e-42a3-8c3e-ae7091851941 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:09:06.170775 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828c6da-cea0-45b1-baf6-0bcdc3461997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:09:06.171444 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c6da-cea0-45b1-baf6-0bcdc3461997 service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:09:06.171725 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c6da-cea0-45b1-baf6-0bcdc3461997 service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:09:06.171996 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828c6da-cea0-45b1-baf6-0bcdc3461997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:09:06.174691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-1828c6da-cea0-45b1-baf6-0bcdc3461997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:09:06.190049 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828c6da-cea0-45b1-baf6-0bcdc3461997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:09:06.192900 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828c6da-cea0-45b1-baf6-0bcdc3461997 service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:09:06.207095 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1444/2885] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:09:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 22 20:09:46.362335 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf9db7-2067-4a8e-b224-33989dacd026 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:09:46.374543 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf9db7-2067-4a8e-b224-33989dacd026 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:09:46.381707 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f74bb-cde2-4cd3-bf32-2f50bcaa9df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:09:46.382411 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f74bb-cde2-4cd3-bf32-2f50bcaa9df5 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:09:46.382695 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f74bb-cde2-4cd3-bf32-2f50bcaa9df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:09:46.382968 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f74bb-cde2-4cd3-bf32-2f50bcaa9df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:09:46.385086 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-059f74bb-cde2-4cd3-bf32-2f50bcaa9df5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:09:46.396752 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f74bb-cde2-4cd3-bf32-2f50bcaa9df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:09:46.398247 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f74bb-cde2-4cd3-bf32-2f50bcaa9df5 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:09:46.407220 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1442/2886] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:09:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:11:35.312066 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828c6da-cea0-45b1-baf6-0bcdc3461997 service nova] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:11:35.323684 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828c6da-cea0-45b1-baf6-0bcdc3461997 service nova] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:11:35.329608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:11:35.330379 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:35.330661 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:35.330941 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:35.333079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:11:35.353535 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:11:35.357777 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:11:35.385415 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1445/2887] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:11:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:11:37.251881 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71495a59-92c5-4f0c-80e4-ddec353977ae None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:37.252439 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71495a59-92c5-4f0c-80e4-ddec353977ae None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:37.252550 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71495a59-92c5-4f0c-80e4-ddec353977ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:37.270562 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-71495a59-92c5-4f0c-80e4-ddec353977ae None None] MFA Rules not processed for user `c4d36290bff7438da07f683c06ea8981`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:11:37.271806 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-71495a59-92c5-4f0c-80e4-ddec353977ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:11:37.278994 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1443/2888] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:11:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:11:38.155046 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:11:38.157040 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:11:38.229554 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bd38-b943-4f37-a86c-deb789b5efde service nova] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:11:38.235086 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d355b-60b2-4c9b-abd8-1e91d8f9e597 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:11:38.235750 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d355b-60b2-4c9b-abd8-1e91d8f9e597 service placement] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:38.236159 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d355b-60b2-4c9b-abd8-1e91d8f9e597 service placement] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:38.236287 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d355b-60b2-4c9b-abd8-1e91d8f9e597 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:38.238504 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-3f3d355b-60b2-4c9b-abd8-1e91d8f9e597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:11:38.253132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d355b-60b2-4c9b-abd8-1e91d8f9e597 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:11:38.255022 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d355b-60b2-4c9b-abd8-1e91d8f9e597 service placement] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:11:38.265887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1446/2889] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:11:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:11:43.487773 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f79f8-005a-4c37-85a7-9df552e3fe53 None None] REQUEST_METHOD: `POST` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:43.488296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f79f8-005a-4c37-85a7-9df552e3fe53 None None] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:43.488296 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f79f8-005a-4c37-85a7-9df552e3fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:43.536364 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.auth.core [None req-481f79f8-005a-4c37-85a7-9df552e3fe53 None None] MFA Rules not processed for user `d526f13b514045ec9ebee14edf3fe79f`. Rule list: `[]` (Enabled: `True`). {{(pid=91345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:11:43.537574 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-481f79f8-005a-4c37-85a7-9df552e3fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:11:43.558603 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1444/2890] 10.222.0.49 () {58 vars in 967 bytes} [Tue Mar 22 20:11:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:11:43.605430 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d355b-60b2-4c9b-abd8-1e91d8f9e597 service placement] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:11:43.627424 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d355b-60b2-4c9b-abd8-1e91d8f9e597 service placement] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:11:43.633291 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd669-95af-469e-9223-a020451a2b7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '439b41be395d4faeae0b855a1e0f25f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:11:43.633925 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd669-95af-469e-9223-a020451a2b7d service swift] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:43.634293 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd669-95af-469e-9223-a020451a2b7d service swift] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:43.634562 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd669-95af-469e-9223-a020451a2b7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:43.643885 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dd669-95af-469e-9223-a020451a2b7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:11:43.645437 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dd669-95af-469e-9223-a020451a2b7d service swift] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:11:43.653755 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1447/2891] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Mar 22 20:11:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 22 20:11:50.875290 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f79f8-005a-4c37-85a7-9df552e3fe53 None None] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:11:50.897462 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f79f8-005a-4c37-85a7-9df552e3fe53 None None] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:11:50.908970 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b918588-1d5d-44a3-8d27-344959c27783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:11:50.909645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918588-1d5d-44a3-8d27-344959c27783 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:50.909924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918588-1d5d-44a3-8d27-344959c27783 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:50.910243 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b918588-1d5d-44a3-8d27-344959c27783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:50.912424 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-5b918588-1d5d-44a3-8d27-344959c27783 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:11:50.929770 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b918588-1d5d-44a3-8d27-344959c27783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:11:50.931813 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b918588-1d5d-44a3-8d27-344959c27783 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:11:50.964448 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1445/2892] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:11:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:11:51.164588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd669-95af-469e-9223-a020451a2b7d service swift] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:11:51.230173 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd669-95af-469e-9223-a020451a2b7d service swift] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:11:51.234994 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:11:51.235997 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:51.236281 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:51.236599 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] PATH_INFO: `/v3/users/42e820c5035149569828245030ee161f` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:51.237806 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e820c5035149569828245030ee161f)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:11:51.239779 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:11:51.286887 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e820c5035149569828245030ee161f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.287866 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e820c5035149569828245030ee161f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.288487 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e820c5035149569828245030ee161f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.297921 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e820c5035149569828245030ee161f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.305155 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e820c5035149569828245030ee161f'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.322781 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1448/2893] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:11:51 2022] DELETE /identity/v3/users/42e820c5035149569828245030ee161f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:11:51.525623 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b918588-1d5d-44a3-8d27-344959c27783 service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:11:51.539632 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b918588-1d5d-44a3-8d27-344959c27783 service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:11:51.599412 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:11:51.600277 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:51.600558 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:51.600835 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] PATH_INFO: `/v3/projects/981b744fb5294e24a8c969e3acb11217` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:51.602102 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981b744fb5294e24a8c969e3acb11217)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:11:51.604014 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:11:51.651143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981b744fb5294e24a8c969e3acb11217', 'request_id': 'req-2be356be-ff6e-4dda-b79e-395e26cad0b1'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.657000 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981b744fb5294e24a8c969e3acb11217', 'request_id': 'req-2be356be-ff6e-4dda-b79e-395e26cad0b1'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.664942 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981b744fb5294e24a8c969e3acb11217', 'request_id': 'req-2be356be-ff6e-4dda-b79e-395e26cad0b1'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.677349 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] The token cache is being invalidate because project 981b744fb5294e24a8c969e3acb11217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:11:51.677642 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.678317 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.680024 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1446/2894] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:11:51 2022] DELETE /identity/v3/projects/981b744fb5294e24a8c969e3acb11217 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:11:51.684231 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:11:51.686161 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:11:51.699785 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfa3c0-dcd4-47e0-b794-bd4f4cfe7ada admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:11:51.758698 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:11:51.759726 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:51.759991 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:51.760260 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] PATH_INFO: `/v3/users/5d7c1bd492a641ac801aa29e5c6e1b00` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:51.762274 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7c1bd492a641ac801aa29e5c6e1b00)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:11:51.764675 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:11:51.816482 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7c1bd492a641ac801aa29e5c6e1b00'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.817721 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7c1bd492a641ac801aa29e5c6e1b00'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.818540 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7c1bd492a641ac801aa29e5c6e1b00'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.828588 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7c1bd492a641ac801aa29e5c6e1b00'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.842816 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7c1bd492a641ac801aa29e5c6e1b00'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:51.856915 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1449/2895] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:11:51 2022] DELETE /identity/v3/users/5d7c1bd492a641ac801aa29e5c6e1b00 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:11:52.049752 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:11:52.051466 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:11:52.069471 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be356be-ff6e-4dda-b79e-395e26cad0b1 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:11:52.129645 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:11:52.130609 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:11:52.130924 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:11:52.131222 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] PATH_INFO: `/v3/projects/a51efb424b634b74a38a98df36c66072` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:11:52.132493 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51efb424b634b74a38a98df36c66072)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:11:52.134452 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:11:52.194347 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51efb424b634b74a38a98df36c66072', 'request_id': 'req-0b633810-a6f0-4866-832f-7ece7e394bdf'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:52.200658 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51efb424b634b74a38a98df36c66072', 'request_id': 'req-0b633810-a6f0-4866-832f-7ece7e394bdf'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:52.209036 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51efb424b634b74a38a98df36c66072', 'request_id': 'req-0b633810-a6f0-4866-832f-7ece7e394bdf'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:52.222167 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] The token cache is being invalidate because project a51efb424b634b74a38a98df36c66072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:11:52.222452 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:52.223198 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:11:52.224842 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1447/2896] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:11:52 2022] DELETE /identity/v3/projects/a51efb424b634b74a38a98df36c66072 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:12:43.448845 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:12:43.450547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:12:43.525170 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884bcfd-cf8c-4f71-bcd0-6448649bd8b7 admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:12:43.584211 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a7776-51f7-4629-99c2-9fe4847fcbfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:12:43.584904 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a7776-51f7-4629-99c2-9fe4847fcbfb service placement] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:12:43.585195 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a7776-51f7-4629-99c2-9fe4847fcbfb service placement] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:12:43.585465 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a7776-51f7-4629-99c2-9fe4847fcbfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:12:43.587609 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-339a7776-51f7-4629-99c2-9fe4847fcbfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:12:43.599125 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a7776-51f7-4629-99c2-9fe4847fcbfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:12:43.600784 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a7776-51f7-4629-99c2-9fe4847fcbfb service placement] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:12:43.610732 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1450/2897] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:12:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:13:57.234556 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:13:57.237260 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:13:57.304328 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b633810-a6f0-4866-832f-7ece7e394bdf admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:13:57.308834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:13:57.309485 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:13:57.309768 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:13:57.310071 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:13:57.312280 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:13:57.373822 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:13:57.375352 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:13:57.385004 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1448/2898] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:13:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:14:09.510547 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acebcb-34e0-4664-a6a0-0d9da7f1a65f None None] REQUEST_METHOD: `POST` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:14:09.511073 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acebcb-34e0-4664-a6a0-0d9da7f1a65f None None] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:14:09.511205 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acebcb-34e0-4664-a6a0-0d9da7f1a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:14:09.530615 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.auth.core [None req-44acebcb-34e0-4664-a6a0-0d9da7f1a65f None None] MFA Rules not processed for user `c4d36290bff7438da07f683c06ea8981`. Rule list: `[]` (Enabled: `True`). {{(pid=91344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 22 20:14:09.531817 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-44acebcb-34e0-4664-a6a0-0d9da7f1a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:09.540283 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1451/2899] 10.222.0.49 () {58 vars in 957 bytes} [Tue Mar 22 20:14:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 22 20:14:09.578930 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:14:09.580883 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:09.592839 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74dec-3c28-4d38-bb6d-d92b8cda244b service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:14:09.597249 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908e60013ebe4372a803a2ae5223e2c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:14:09.597894 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:14:09.598202 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:14:09.598473 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:14:09.600475 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:09.678373 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:14:09.679729 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:14:09.690553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1449/2900] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:14:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:14:10.008144 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acebcb-34e0-4664-a6a0-0d9da7f1a65f None None] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:14:10.009967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-44acebcb-34e0-4664-a6a0-0d9da7f1a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:10.070224 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acebcb-34e0-4664-a6a0-0d9da7f1a65f None None] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:14:10.074192 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb434-9945-4365-88ad-ea1e6c902374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:14:10.074823 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb434-9945-4365-88ad-ea1e6c902374 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:14:10.075101 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb434-9945-4365-88ad-ea1e6c902374 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:14:10.075373 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb434-9945-4365-88ad-ea1e6c902374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:14:10.077658 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-ba7fb434-9945-4365-88ad-ea1e6c902374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:10.087172 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fb434-9945-4365-88ad-ea1e6c902374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:14:10.088608 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fb434-9945-4365-88ad-ea1e6c902374 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:14:10.097524 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1452/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:14:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:14:10.588674 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:14:10.590334 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:10.602149 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0ee6-6806-423d-9d2c-4b6ff3cdbfc3 service cinder] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:14:10.605834 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:14:10.606524 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:14:10.606801 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:14:10.607246 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:14:10.609083 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:10.623531 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:14:10.625120 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:14:10.637133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1450/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:14:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:14:26.243787 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb434-9945-4365-88ad-ea1e6c902374 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:14:26.253453 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb434-9945-4365-88ad-ea1e6c902374 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:14:26.258121 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d634c-5019-4c0c-999a-8a70efe14462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:14:26.258756 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d634c-5019-4c0c-999a-8a70efe14462 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:14:26.259039 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d634c-5019-4c0c-999a-8a70efe14462 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:14:26.259302 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d634c-5019-4c0c-999a-8a70efe14462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:14:26.261337 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9a9d634c-5019-4c0c-999a-8a70efe14462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:26.327919 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d634c-5019-4c0c-999a-8a70efe14462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:14:26.329353 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d634c-5019-4c0c-999a-8a70efe14462 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:14:26.339959 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1453/2903] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:14:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:14:28.178508 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:14:28.180606 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:28.194943 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dfd85-592d-49fe-a136-d087c8a83da5 service neutron] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:14:28.202009 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f232cb-7b11-405d-a066-10032eb1cba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:14:28.202654 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f232cb-7b11-405d-a066-10032eb1cba1 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:14:28.202932 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f232cb-7b11-405d-a066-10032eb1cba1 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:14:28.203204 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f232cb-7b11-405d-a066-10032eb1cba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:14:28.205064 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-11f232cb-7b11-405d-a066-10032eb1cba1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:28.218077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f232cb-7b11-405d-a066-10032eb1cba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:14:28.219673 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f232cb-7b11-405d-a066-10032eb1cba1 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:14:28.230551 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1451/2904] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:14:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:14:49.174493 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d634c-5019-4c0c-999a-8a70efe14462 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:14:49.184834 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d634c-5019-4c0c-999a-8a70efe14462 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:14:49.189511 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee044d-cb35-43b9-9609-c7accaca6571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:14:49.190217 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee044d-cb35-43b9-9609-c7accaca6571 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:14:49.190490 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee044d-cb35-43b9-9609-c7accaca6571 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:14:49.190761 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee044d-cb35-43b9-9609-c7accaca6571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:14:49.192952 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-9dee044d-cb35-43b9-9609-c7accaca6571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:14:49.203203 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee044d-cb35-43b9-9609-c7accaca6571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:14:49.204673 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee044d-cb35-43b9-9609-c7accaca6571 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:14:49.213261 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1454/2905] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:14:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:16:35.122628 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f232cb-7b11-405d-a066-10032eb1cba1 service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:16:35.169057 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f232cb-7b11-405d-a066-10032eb1cba1 service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:16:35.175087 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f74d49fc68344899f70efb85eb1c97d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:16:35.175745 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:16:35.176026 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:16:35.176353 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:16:35.178158 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:16:35.217491 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:16:35.219164 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:16:35.240182 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1452/2906] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:16:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:16:40.718666 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee044d-cb35-43b9-9609-c7accaca6571 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:16:40.761699 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee044d-cb35-43b9-9609-c7accaca6571 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:16:40.766303 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941e808-eb9e-4cc9-a8cd-ce96f61ee082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2e837368cdc4df29d945a4c8e662a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:16:40.766953 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941e808-eb9e-4cc9-a8cd-ce96f61ee082 service neutron] REQUEST_METHOD: `GET` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:16:40.767236 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941e808-eb9e-4cc9-a8cd-ce96f61ee082 service neutron] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:16:40.767517 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941e808-eb9e-4cc9-a8cd-ce96f61ee082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:16:40.769356 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-4941e808-eb9e-4cc9-a8cd-ce96f61ee082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:16:40.855325 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941e808-eb9e-4cc9-a8cd-ce96f61ee082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:16:40.856807 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941e808-eb9e-4cc9-a8cd-ce96f61ee082 service neutron] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:16:40.875585 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1455/2907] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 22 20:16:47.669059 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:16:47.670630 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:16:47.685561 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166460fb-3543-475c-b1ef-18634c590f66 service nova] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:16:47.690143 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:16:47.691008 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:16:47.691283 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:16:47.691553 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] PATH_INFO: `/v3/users/c4d36290bff7438da07f683c06ea8981` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:16:47.692719 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d36290bff7438da07f683c06ea8981)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:16:47.694675 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:16:47.744701 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d36290bff7438da07f683c06ea8981'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:47.757836 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d36290bff7438da07f683c06ea8981'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:47.767133 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d36290bff7438da07f683c06ea8981'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:47.767772 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d36290bff7438da07f683c06ea8981'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:47.774889 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d36290bff7438da07f683c06ea8981'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:47.781127 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1453/2908] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:16:47 2022] DELETE /identity/v3/users/c4d36290bff7438da07f683c06ea8981 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:16:47.975147 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941e808-eb9e-4cc9-a8cd-ce96f61ee082 service neutron] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:16:47.985317 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941e808-eb9e-4cc9-a8cd-ce96f61ee082 service neutron] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:16:48.051587 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:16:48.052518 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:16:48.052815 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:16:48.053079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] PATH_INFO: `/v3/projects/76cde34ed04f4d4297839f0229dd5c25` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:16:48.054431 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=76cde34ed04f4d4297839f0229dd5c25)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:16:48.056361 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:16:48.108014 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76cde34ed04f4d4297839f0229dd5c25', 'request_id': 'req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.113967 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76cde34ed04f4d4297839f0229dd5c25', 'request_id': 'req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.120451 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76cde34ed04f4d4297839f0229dd5c25', 'request_id': 'req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.134457 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] The token cache is being invalidate because project 76cde34ed04f4d4297839f0229dd5c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:16:48.134780 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.135468 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.137079 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1456/2909] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:16:47 2022] DELETE /identity/v3/projects/76cde34ed04f4d4297839f0229dd5c25 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:16:48.141261 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:16:48.142912 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:16:48.161703 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d0dc7-572e-4450-8a7f-76841c4fbd38 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:16:48.225440 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:16:48.226377 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:16:48.226692 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:16:48.226965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] PATH_INFO: `/v3/users/b3bcda9f3eea46edafd02558b7d16bfb` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:16:48.228245 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3bcda9f3eea46edafd02558b7d16bfb)` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:16:48.230308 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:16:48.278998 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3bcda9f3eea46edafd02558b7d16bfb'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.290345 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3bcda9f3eea46edafd02558b7d16bfb'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.300077 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3bcda9f3eea46edafd02558b7d16bfb'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.300736 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3bcda9f3eea46edafd02558b7d16bfb'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.307324 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.notifications [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3bcda9f3eea46edafd02558b7d16bfb'} {{(pid=91345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.313704 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1454/2910] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Mar 22 20:16:48 2022] DELETE /identity/v3/users/b3bcda9f3eea46edafd02558b7d16bfb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:16:48.495857 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] Authenticating user token {{(pid=91344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:16:48.497304 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.fernet_utils [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:16:48.510819 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7285b-2bce-4d01-ac5a-6ab7a67e5aad admin admin] Validating token access rules against request {{(pid=91344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:16:48.572132 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686bfe5266224121af654efbb4f624b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9df87fda527d419183d70b258d3b9b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:16:48.573000 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:16:48.573280 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:16:48.573691 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] PATH_INFO: `/v3/projects/c82636e247354f5081b8fe14e0328fd6` {{(pid=91344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:16:48.574946 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82636e247354f5081b8fe14e0328fd6)` {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:16:48.576927 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] RBAC: Authorization granted {{(pid=91344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:16:48.628004 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82636e247354f5081b8fe14e0328fd6', 'request_id': 'req-d5574a98-e54b-4890-881a-5b910c09e4e2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.633963 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82636e247354f5081b8fe14e0328fd6', 'request_id': 'req-d5574a98-e54b-4890-881a-5b910c09e4e2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.640680 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82636e247354f5081b8fe14e0328fd6', 'request_id': 'req-d5574a98-e54b-4890-881a-5b910c09e4e2'} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.655476 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] The token cache is being invalidate because project c82636e247354f5081b8fe14e0328fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 22 20:16:48.655753 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.656469 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: DEBUG keystone.notifications [None req-d5574a98-e54b-4890-881a-5b910c09e4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 22 20:16:48.658120 dv-cinder-739079-9-iscsi devstack@keystone.service[91344]: [pid: 91344|app: 0|req: 1457/2911] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Mar 22 20:16:48 2022] DELETE /identity/v3/projects/c82636e247354f5081b8fe14e0328fd6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 22 20:17:47.439569 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] Authenticating user token {{(pid=91345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 22 20:17:47.441096 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:17:47.550006 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1020c7f-248e-4bff-81b8-d93801645671 admin admin] Validating token access rules against request {{(pid=91345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 22 20:17:47.617712 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e0c9a-1196-4a42-bf46-6f5246b3fe1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed3ec40f28c4bc990d8f56466889aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '223e4823a4424338869a4b614a8dceb5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 22 20:17:47.618407 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e0c9a-1196-4a42-bf46-6f5246b3fe1d service placement] REQUEST_METHOD: `GET` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 22 20:17:47.618688 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e0c9a-1196-4a42-bf46-6f5246b3fe1d service placement] SCRIPT_NAME: `/identity` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 22 20:17:47.618965 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e0c9a-1196-4a42-bf46-6f5246b3fe1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 22 20:17:47.621046 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.fernet_utils [None req-b59e0c9a-1196-4a42-bf46-6f5246b3fe1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 22 20:17:47.632915 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e0c9a-1196-4a42-bf46-6f5246b3fe1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 22 20:17:47.634560 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e0c9a-1196-4a42-bf46-6f5246b3fe1d service placement] RBAC: Authorization granted {{(pid=91345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 22 20:17:47.644916 dv-cinder-739079-9-iscsi devstack@keystone.service[91345]: [pid: 91345|app: 0|req: 1455/2912] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Mar 22 20:17:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)